-- Logs begin at Wed 2022-08-24 11:53:38 UTC, end at Wed 2022-08-24 12:51:17 UTC. -- Aug 24 12:24:05.920341 dv-cinder-848900-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 12:24:05.930463 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 12:24:05.932471 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 12:24:05 2022] *** Aug 24 12:24:05.932471 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 12:24:05.932471 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 12:24:05.932471 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: nodename: dv-cinder-848900-5-iscsi Aug 24 12:24:05.932471 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: machine: x86_64 Aug 24 12:24:05.932471 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: clock source: unix Aug 24 12:24:05.932471 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: pcre jit disabled Aug 24 12:24:05.932471 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: detected number of CPU cores: 4 Aug 24 12:24:05.932471 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: current working directory: / Aug 24 12:24:05.933123 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: detected binary path: /usr/bin/uwsgi-core Aug 24 12:24:05.933123 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: your processes number limit is 47680 Aug 24 12:24:05.933123 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: your memory page size is 4096 bytes Aug 24 12:24:05.933123 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: detected max file descriptor number: 2048 Aug 24 12:24:05.933123 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: lock engine: pthread robust mutexes Aug 24 12:24:05.933123 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: thunder lock: enabled Aug 24 12:24:05.933123 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 12:24:05.933123 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 12:24:05.972551 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: Python main interpreter initialized at 0x55afe366f9c0 Aug 24 12:24:05.972551 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: python threads support enabled Aug 24 12:24:05.972551 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: your server socket listen backlog is limited to 100 connections Aug 24 12:24:05.972551 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: your mercy for graceful operations on workers is 90 seconds Aug 24 12:24:05.972940 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 12:24:05.973023 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: *** Operational MODE: preforking *** Aug 24 12:24:05.973219 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: *** uWSGI is running in multiple interpreter mode *** Aug 24 12:24:05.973219 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: spawned uWSGI master process (pid: 105635) Aug 24 12:24:05.973426 dv-cinder-848900-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 12:24:05.973977 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: spawned uWSGI worker 1 (pid: 105636, cores: 1) Aug 24 12:24:05.976836 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: spawned uWSGI worker 2 (pid: 105637, cores: 1) Aug 24 12:24:05.976836 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 12:24:06.636295 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 12:24:06.646932 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 12:24:07.722865 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:24:07.722865 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: from cryptography.utils import int_from_bytes Aug 24 12:24:07.723486 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:24:07.723486 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: from cryptography.utils import int_from_bytes Aug 24 12:24:07.724239 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:24:07.724239 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: from cryptography.utils import int_from_bytes Aug 24 12:24:07.724362 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:24:07.724362 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: from cryptography.utils import int_from_bytes Aug 24 12:24:10.299026 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 12:24:10.299579 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 12:24:10.299765 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 12:24:10.300064 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 12:24:10.300316 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 12:24:10.300698 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.301020 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.301338 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.301653 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.301961 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 12:24:10.302325 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.302422 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 12:24:10.302505 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.302594 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.302730 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 12:24:10.302870 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.303096 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 12:24:10.303201 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.303359 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 12:24:10.303456 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.303750 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.303840 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.304072 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-5-iscsi {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.304173 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.304387 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.304480 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.304691 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.304786 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.305009 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.305105 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.305314 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.305421 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.305610 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.305699 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.305927 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.306014 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.306226 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.306313 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.306500 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.306722 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.308161 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.308161 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-5-iscsi {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.308445 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.308445 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.308785 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.309013 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.309191 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.309191 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.309516 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.309693 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.309869 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.310084 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.310241 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.310241 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.310624 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.310782 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.310996 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.311186 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.311344 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.311573 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.311781 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.311970 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-5-iscsi {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.312121 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.312298 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.312474 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.312650 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.312835 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.313061 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.313196 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.313354 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.313480 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.313614 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.313775 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.313900 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.314022 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.314145 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.314282 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.314450 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.314582 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.314720 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.314852 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-5-iscsi {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.315046 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.315175 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.315316 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.315505 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.315674 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.315823 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.315959 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.315959 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.316194 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.316316 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.316446 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.316576 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.316698 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.316819 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.316948 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.317079 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.317202 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.317323 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.317456 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.317579 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.317700 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.317830 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.317953 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.318113 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.318244 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.318409 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.318564 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.318706 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.318706 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.318958 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.319081 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.319214 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.319347 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.319470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.319597 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.319782 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.319907 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.320030 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.320161 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.320291 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.320423 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.320553 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.320676 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.320877 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.321003 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.321133 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.321263 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.321387 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.321518 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.321650 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.321775 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.321897 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.322026 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.322157 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.322280 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.322411 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.322792 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.322915 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.323037 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.323158 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.323288 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.323418 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.323418 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.323700 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.323832 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.323960 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.323960 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.324205 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.324205 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.324435 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.324565 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.324695 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.324826 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.324949 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.325084 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.325279 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.325413 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.325620 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.325620 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.325863 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.325984 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.326112 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.326233 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.326367 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.326490 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.326617 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.326739 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.326867 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.326995 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.327129 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.327252 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.327379 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.327508 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.327655 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.327795 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.327931 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.328053 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.328207 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.328332 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.328454 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.329064 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.329196 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.329320 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.329441 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.329562 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.329712 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.329849 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.330014 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.330140 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.330316 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.330443 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.330617 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.330753 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.330885 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.331007 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.331182 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.331309 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.331488 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.331661 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.331815 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.331943 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.332116 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.332243 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.332421 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.332556 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.332730 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.332863 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.333027 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.333153 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.333328 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.333462 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.333627 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.333783 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.333951 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.334085 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.334208 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.334337 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.334515 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.334640 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.334815 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.334941 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.335119 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.335259 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.335450 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.335596 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.335832 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.335967 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.336090 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.336204 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.336351 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.336484 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.336653 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.336780 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.336968 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.337095 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.337265 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.337400 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.337566 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.337691 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.337876 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.338010 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.338183 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.338350 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.338472 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.338595 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.338770 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.338906 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.339068 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.339202 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.339367 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.339504 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.339672 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.339799 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.339974 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.340111 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.340272 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.340409 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.340567 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.340695 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.340879 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.341008 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.341195 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.341332 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.341499 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.341627 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.341799 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.341938 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.342097 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.342234 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.342399 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.342532 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.342706 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.342833 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.343013 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.343150 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.343321 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.343457 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.343642 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.343765 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.343954 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.344092 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.344852 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.344983 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.345169 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.345295 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.345489 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.345626 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.345798 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.345900 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.346120 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.346218 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.346428 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.346526 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.346736 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.346841 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:10.347044 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.347141 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.347363 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.347499 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.347698 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.347828 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.348034 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.348179 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.348344 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.348508 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.348633 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.348757 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.348939 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.349076 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.349243 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.349387 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.349555 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.349702 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.349878 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.350015 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.350194 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.350322 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.350500 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.350627 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.350835 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.350972 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.351154 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.351280 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.351463 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.351589 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.351809 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.351952 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.352127 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.352254 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.352432 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.352561 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.352737 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.352880 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.353039 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.353174 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.353353 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.353490 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.353676 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.353812 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.353983 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.354110 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.354295 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.354428 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.354596 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.354724 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.354901 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.355031 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.355207 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.355335 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.355512 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.355760 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.355905 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.356097 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.356233 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.356358 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.356488 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.356612 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.356756 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.356892 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.357064 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.357205 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.357378 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.357514 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.357685 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.357812 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.357996 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.358133 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.358303 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.358472 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.358605 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.358729 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.358887 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.359023 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.359187 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.359314 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.359491 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.359652 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.359823 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.360002 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.360130 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.360351 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.360590 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.360717 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.360899 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.361028 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.361229 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.361365 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.361534 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.361671 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.361841 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.361970 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.362146 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.362274 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.362451 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.362578 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.362753 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.362883 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.363058 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.363192 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.363359 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.363486 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.363679 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.363826 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.363999 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.364127 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.364304 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.364433 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.364604 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.364733 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.364921 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.365050 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.365221 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.365358 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.365520 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.365657 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.365867 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.365994 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.366143 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.366341 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.366469 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.366593 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.366723 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.366846 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.366990 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.367127 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.367302 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.367428 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.367605 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.367801 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.367938 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.368063 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.368239 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.368366 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.368561 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.368697 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.368860 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.368988 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.369164 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.369289 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.369482 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.369609 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.369813 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.369938 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.370064 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.370187 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.370364 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.370491 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.370666 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.370795 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.370968 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.371102 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.371270 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.371404 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.371575 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.371725 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.371903 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.372031 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.372205 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.372340 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.372507 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.372641 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.372805 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.372945 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.373103 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.373244 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.373422 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.373549 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.373728 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.373856 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.374030 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.374171 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.374332 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.374459 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.374632 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.374759 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.374933 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.375074 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.375247 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.375405 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.375602 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.375778 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.375993 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.376233 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.376374 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.376563 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.376691 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.376822 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.376955 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.377149 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.377283 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.377459 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.377585 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.377764 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.377898 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.378071 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.378197 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.378373 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.378507 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.378675 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.378807 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.378983 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.379119 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.379291 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.379418 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.379605 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.379757 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.379935 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.380063 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.380257 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.380384 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.380565 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.380700 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.380881 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.381008 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.381182 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.381318 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.381492 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.381620 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.381806 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.381932 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.382122 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.382250 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.382439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.382577 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.382750 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.382883 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.383053 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.383192 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.383364 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.383492 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.383691 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.383822 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.384001 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.384138 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.384307 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.384436 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.384615 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.384742 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.384927 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.385062 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.385228 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.385362 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.385538 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.385673 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.385841 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.385994 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.386183 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.386310 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.386434 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.386572 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.386758 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.386895 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.387020 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.387143 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.387318 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.387446 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.387652 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.387784 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.387983 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.388110 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.388294 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.388420 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.388600 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.388773 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.388918 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.389050 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.389221 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.389346 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.389525 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.389654 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.389831 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.389965 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.390131 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.390257 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.390430 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.390558 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.390732 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.390859 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.391573 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.391730 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.391937 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.392064 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.392252 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.392382 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.392570 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.392711 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.392896 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.393024 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.393209 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.393337 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.393520 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.393656 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.393818 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.393945 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.394123 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.394258 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.394428 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.394564 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.394730 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.394857 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.395043 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.395169 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.395356 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.395482 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.395676 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.395809 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.395977 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.396115 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.396329 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.396463 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.396587 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.396709 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.396910 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.397039 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.397171 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.397295 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.397419 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.397542 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.397752 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.397881 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.398058 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.398187 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.398358 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.398486 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.398669 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.398911 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.399039 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.399161 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.399291 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.399414 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.399570 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.399728 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.399900 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.400026 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.400203 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.400322 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.400516 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.400652 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.400821 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.400948 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.401124 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.401252 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.401429 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.401565 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.401735 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.401862 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.402127 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.402257 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.402373 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.402481 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.402634 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.402762 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.402939 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.403067 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.403244 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.403372 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.403549 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.403728 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.403875 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.404003 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.404180 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.404317 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.404491 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.404619 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.404799 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.405053 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.405190 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.405379 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.405506 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.405689 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.405817 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.406000 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.406129 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.406368 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.406505 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.406711 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.407413 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.407554 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.407724 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.408054 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.408193 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.408382 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.408510 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.408683 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.408860 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.408987 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.409259 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.409386 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.409573 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.409700 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.409880 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.410009 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.410184 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.410312 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.410489 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.410616 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.410789 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.410917 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.411095 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.411222 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.411396 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.411523 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.411728 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.411870 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.412030 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.412166 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.412331 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.412458 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.412640 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.412777 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.412941 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.413070 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.413248 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.413376 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.413550 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.413686 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.413869 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.414004 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.414172 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.414298 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.414469 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.414596 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.414769 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.414896 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.415068 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.415199 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.415371 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.415498 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.415703 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.415846 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.416023 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.416151 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.416330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.416536 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.416664 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.416787 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.416938 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.417073 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.417238 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.417363 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.417566 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.417703 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.417827 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.417961 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.418127 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.418263 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.418426 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.418553 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.418737 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.418916 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.419053 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.419167 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.419322 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.419449 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.419643 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.419788 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.419952 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.420088 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.420258 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.420386 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.420562 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.420690 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.420859 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.420986 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.421163 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.421290 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.421462 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.421590 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.421771 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.421898 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.422075 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.422224 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.422434 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.422687 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.422837 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.423002 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.423136 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.423268 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.423470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.423596 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.423753 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.423878 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.424001 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.424155 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.424284 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.424466 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.424586 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.424765 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.424894 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.425063 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.425199 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.425361 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.425499 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.425665 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.425792 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.425967 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.426097 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.426264 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.426399 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.426577 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.426696 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.426878 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.426977 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.427175 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.427272 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.427475 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.427581 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.427803 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.427900 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.428097 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.428191 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.428394 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.428510 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.428704 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.428807 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.429006 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.429108 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.429316 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.429425 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.429615 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.429711 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.429916 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.430011 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.430209 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.430313 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.430508 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.430618 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.430805 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.430902 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.431104 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.431193 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.431398 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.431487 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.431718 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.431809 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.432018 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.432108 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.432315 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.432402 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.432612 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.432709 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.432928 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.433017 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.433230 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.433317 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.433528 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.433618 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.433845 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.433952 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.434125 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.434220 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.434450 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.434545 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.434746 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.434832 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.435055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.435142 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.435359 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.435456 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.435684 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.435775 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.435994 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.436091 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.436299 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.436401 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.436599 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.436693 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.436906 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.436994 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.437207 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.437305 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.437511 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.437598 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.437812 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.437927 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.438187 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.438364 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.438485 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.438574 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.438772 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.438932 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.439087 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.439246 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.439396 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.439572 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.439796 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.439925 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.440100 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.440241 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.440416 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.440553 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.440724 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.440851 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.441019 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.441148 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.441322 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.441450 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.441628 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.441756 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.441932 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.442071 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.442235 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.442362 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.442537 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.442673 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.442842 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.442969 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.443146 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.443274 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.443450 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.443591 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.443775 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.443901 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.444074 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.444203 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.444375 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.444511 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.444680 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.444815 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.444983 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.445110 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.445282 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.445418 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.445598 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.445725 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.445903 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.446038 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.446201 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.446330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.446503 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.446631 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.446806 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.446912 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.447111 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.447209 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.447409 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.447770 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.448014 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.448121 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.448326 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.448423 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.448639 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.448735 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.448952 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.449048 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.449263 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.449360 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.449561 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.449664 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.449872 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.449977 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.450179 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.450283 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.450479 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.450575 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.450789 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.450934 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.451103 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.451244 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.451410 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.451539 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.451779 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.451990 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.452117 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.452241 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.452363 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.452487 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.452651 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.452788 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.452967 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.453094 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.453266 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.453394 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.454127 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.454273 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.454427 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.454602 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.454847 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.454975 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.455154 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.455327 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.455462 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.455660 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.455897 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.456025 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.456204 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.456333 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.456505 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.456640 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.456878 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.457072 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.457211 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.457337 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.457491 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.457619 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.457795 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.457943 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.458134 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.458262 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.458384 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.458507 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.458695 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.458837 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.459000 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.459126 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.459288 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.459410 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.459602 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.459736 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.459951 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.460055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.460256 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.460354 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.460566 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.460755 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.460880 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.461072 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.461168 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.461387 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.461491 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.461714 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.461818 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.462040 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.462145 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.462367 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.462472 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.462676 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.462854 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.462995 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.463132 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.463308 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.463436 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.463663 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.463806 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.463957 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.464086 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.464256 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.464384 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.464560 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.464697 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.464859 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.464987 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.465160 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.465288 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.465475 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.465612 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.465774 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.465909 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.466078 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.466208 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.466380 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.466509 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.466684 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.466811 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.466982 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.467191 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.467329 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.467455 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.467578 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.467744 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.467893 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.468056 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.468279 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.468409 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.468533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.468656 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.468805 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.468955 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.469754 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.469869 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.470090 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.470194 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.470404 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.470511 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.470708 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.470812 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.471006 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.471180 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.471319 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.471465 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.471601 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.471764 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.471950 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.472039 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.472250 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.472356 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.472564 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.472654 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.472888 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.472978 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.473210 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.473311 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.473515 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.473605 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.473838 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.473926 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.474146 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.474244 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.474455 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.474543 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.474769 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.474864 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.475077 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.475166 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.475372 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.475459 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.475695 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.475823 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.476005 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.476095 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.476305 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.476393 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.476608 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.476733 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.476906 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.477003 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.477211 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.477306 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.477509 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.477608 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.477807 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.477897 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.478108 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.478195 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.478426 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.478571 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.478720 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.478855 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.479030 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.479168 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.479336 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.479481 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.479645 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.479778 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.479947 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.480082 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.480244 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.480396 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.480581 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.480733 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.480870 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.481004 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.481188 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.481323 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.481495 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.481633 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.481798 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.481934 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.482107 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.482245 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.482415 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.482559 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.482707 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.482840 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.483019 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.483156 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.483328 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.483465 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.483643 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.483777 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.483958 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.484102 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.484260 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.484394 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.484567 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.484718 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.484914 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.485095 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.485231 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.485363 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.485580 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.485725 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.485910 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.486049 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.486233 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.486370 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.486553 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.486710 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.486871 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.487008 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.487189 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.487326 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.487509 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.487672 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.487840 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.487976 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.488151 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.488288 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.488458 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.488612 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.488756 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.488890 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.489074 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.489209 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.489387 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.489524 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.489708 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.489911 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.490044 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.490251 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.490391 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.490584 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.490733 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.490907 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.491045 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.491231 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.491364 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.491552 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.491717 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.491897 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.492049 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.492328 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.492470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.492625 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.492760 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.492900 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.493046 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.493181 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.493315 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.493457 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.493591 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.493724 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.493864 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.493998 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.494131 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.494265 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.494408 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.494543 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.494684 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.494820 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.495001 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.495138 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.495323 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.495470 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.495675 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.495827 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.496040 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.496198 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.496341 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.496484 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.496648 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.496785 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.496959 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.497096 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.497271 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.497409 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.497588 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.497785 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.497922 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.498093 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.498251 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.498420 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.498512 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.498747 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.498885 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.499065 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.499215 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.499376 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.499520 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.499714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.499861 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.500043 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.500205 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.500343 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.500529 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.500671 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.500809 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.500954 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.501090 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.501230 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.501350 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.501535 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.501669 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.501833 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.501971 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.502140 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.502439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.502582 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.502752 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.502898 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.503058 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.503195 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.503414 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.503580 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.503753 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.503947 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.504084 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.504259 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.504414 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.504581 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.504726 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.504903 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.505040 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.505217 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.505353 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.505521 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.505671 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.505841 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.505986 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.506144 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.506292 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.506428 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.506572 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.506738 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.506887 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.507043 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.507179 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.507376 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.507522 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.507727 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.507861 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.507996 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.508204 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.508363 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.508519 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.508654 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.508830 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.508972 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.509129 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.509274 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.509449 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.509592 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.509734 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.509878 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.510034 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.510200 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.510344 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.510488 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.510624 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.510764 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.510906 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.511039 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.511171 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.511307 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.511470 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.511603 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.511795 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.511934 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.512101 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.512247 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.512400 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.512532 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.512705 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.512838 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.513002 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.513134 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.513307 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.513439 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.513607 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.513740 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.513909 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.514056 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.514206 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.514338 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.514520 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.514653 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.514819 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.514952 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.515157 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.515299 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.515465 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.515596 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.515779 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.515912 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.516611 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.516760 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.516922 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.517013 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.517228 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.517365 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.517567 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.517729 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.517865 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.518008 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.518220 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.518390 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.518528 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.518731 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.518875 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.519051 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.519188 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.519382 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.519527 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.519736 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.519882 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.520044 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.520150 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.520348 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.520489 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.520650 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.520798 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.520970 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.521107 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.521277 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.521493 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.521634 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.521721 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.521876 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.521974 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.522182 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.522272 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.522488 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.522578 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.522795 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.523070 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.523166 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.523391 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.523479 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.523718 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.523811 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.524024 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.524126 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.524328 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.524417 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.524629 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.524717 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.524933 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.525030 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.525237 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.525338 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.525545 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.525636 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.525882 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.525972 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.526197 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.526293 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.526507 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.526595 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.526813 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.526901 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.527125 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.527212 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.527428 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.527513 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.527757 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.527847 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.528063 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.528163 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.528369 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.528471 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.528678 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.528772 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.528992 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.529080 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.529296 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.529394 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.529598 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.529694 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.529909 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.529997 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.530235 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.530336 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.530581 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.530670 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.530895 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.530982 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.531201 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.531291 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.531516 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.531602 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.532446 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.532578 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.532766 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.532855 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.533082 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.533177 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.533397 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.533486 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.533709 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.533834 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.534029 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.534117 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.534363 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.534450 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.534676 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.534764 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.534977 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.535062 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.535280 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.535378 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.535582 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.535721 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.535980 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.536068 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.536298 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.536401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.536604 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.536692 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.536905 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.536992 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.537204 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.537293 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.537511 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.537600 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.537810 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.537898 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.538111 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.538200 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.538412 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.538509 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.538718 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.538808 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.539023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.539141 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.539321 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.539472 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.539637 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.539811 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.539938 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.540128 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.540224 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.540442 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.540589 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.540757 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.540908 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.541083 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.541220 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.541376 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.541516 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.541677 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.541823 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.541976 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.542112 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.542276 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.542427 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.542572 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.542704 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.542876 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.542964 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.543186 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.543276 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.543495 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.543583 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.543829 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.543926 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.544134 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.544230 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.544437 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.544524 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.544741 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.544837 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.545046 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.545142 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.545355 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.545444 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.545662 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.545756 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.545967 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.546068 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.546272 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.546358 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.546582 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.546671 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.546885 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.546981 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.547206 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.547296 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.547531 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.547646 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.547865 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.547999 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.548172 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.548298 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.548495 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.548619 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.548824 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.548948 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.549173 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.549270 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.549448 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.549579 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.549761 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.549897 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.550079 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.550231 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.550391 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.550601 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.550689 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.550867 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.551005 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.551181 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.551311 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.551516 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.551612 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.551857 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.551946 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.552174 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.552262 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.552490 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.552580 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.552806 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.552894 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.553111 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.553207 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.553418 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.553515 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.553728 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.553817 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.554037 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.554133 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.554358 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.554446 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.554677 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.554765 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.554983 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.555085 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.555304 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.555401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.555658 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.555750 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.555961 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.556059 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.556365 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.556551 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.556661 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.556748 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.556898 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.556989 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.557202 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.557289 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.557507 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.557595 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.557806 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.557895 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.558045 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 12:24:10.558134 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.558420 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.558737 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.559055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.559375 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.559731 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.560068 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.560383 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.560714 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.561046 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.561396 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.561715 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.562063 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.562395 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.562715 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.563682 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.564003 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:10.564247 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 12:24:10.712623 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO dbcounter [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Registered counter for database nova_api Aug 24 12:24:10.719292 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO dbcounter [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] Registered counter for database nova_api Aug 24 12:24:10.734059 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_db.sqlalchemy.engines [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:10.739000 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG oslo_db.sqlalchemy.engines [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:10.740854 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG dbcounter [-] [105636] Writer thread running {{(pid=105636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:10.745364 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG dbcounter [-] [105637] Writer thread running {{(pid=105637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:10.798292 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.context [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87459494-59a1-454d-a2fa-293053432209(cell1) {{(pid=105636) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 12:24:10.802119 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.context [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87459494-59a1-454d-a2fa-293053432209(cell1) {{(pid=105637) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 12:24:10.802245 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:24:10.802729 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:24:10.804350 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:24:10.805087 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:24:10.805537 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:24:10.805997 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG oslo_concurrency.lockutils [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:24:10.806474 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG oslo_concurrency.lockutils [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:24:10.807523 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:24:10.808072 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG oslo_concurrency.lockutils [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:24:10.808820 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG oslo_concurrency.lockutils [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:24:10.809275 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG oslo_concurrency.lockutils [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:24:10.809519 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO dbcounter [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Registered counter for database nova_cell0 Aug 24 12:24:10.811255 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG oslo_concurrency.lockutils [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:24:10.813825 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO dbcounter [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] Registered counter for database nova_cell0 Aug 24 12:24:10.815533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO dbcounter [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Registered counter for database nova_cell1 Aug 24 12:24:10.819248 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO dbcounter [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] Registered counter for database nova_cell1 Aug 24 12:24:10.823240 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_db.sqlalchemy.engines [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:10.825009 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_db.sqlalchemy.engines [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:10.826406 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG oslo_db.sqlalchemy.engines [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:10.830803 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG oslo_db.sqlalchemy.engines [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:10.830943 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG dbcounter [-] [105636] Writer thread running {{(pid=105636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:10.832859 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG dbcounter [-] [105637] Writer thread running {{(pid=105637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:10.836625 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG dbcounter [-] [105636] Writer thread running {{(pid=105636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:10.974370 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG dbcounter [-] [105637] Writer thread running {{(pid=105637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:10.976705 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO dbcounter [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Registered counter for database nova_cell0 Aug 24 12:24:10.983005 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO dbcounter [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] Registered counter for database nova_cell0 Aug 24 12:24:10.986793 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_db.sqlalchemy.engines [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:10.991296 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG dbcounter [-] [105636] Writer thread running {{(pid=105636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:10.992415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG oslo_db.sqlalchemy.engines [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:10.996704 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG dbcounter [-] [105637] Writer thread running {{(pid=105637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:11.331705 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: WARNING keystonemiddleware.auth_token [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:24:11.332663 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: WARNING keystonemiddleware.auth_token [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:24:11.339135 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: WARNING keystonemiddleware.auth_token [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:24:11.339884 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: WARNING keystonemiddleware.auth_token [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:24:11.690172 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: WARNING keystonemiddleware.auth_token [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:24:11.693531 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: WARNING keystonemiddleware.auth_token [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:24:11.696051 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: WARNING keystonemiddleware.auth_token [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:24:11.699898 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: WARNING keystonemiddleware.auth_token [None req-1f1c9cd4-bae6-4578-9719-4e03a73ac621 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:24:11.701564 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55afe366f9c0 pid: 105636 (default app) Aug 24 12:24:11.703685 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:24:11.704948 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001865 Aug 24 12:24:11.705648 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Wed Aug 24 12:24:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:24:11.705831 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55afe366f9c0 pid: 105637 (default app) Aug 24 12:25:30.837167 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:30.838697 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001913 Aug 24 12:25:30.839432 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 12:25:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:30.852415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG dbcounter [-] [105637] Writing DB stats nova_api:SELECT=3 {{(pid=105637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:30.853659 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG dbcounter [-] [105637] Writing DB stats nova_cell0:SELECT=3 {{(pid=105637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:30.854376 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG dbcounter [-] [105637] Writing DB stats nova_cell1:SELECT=3 {{(pid=105637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:30.855351 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG dbcounter [-] [105637] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:31.733889 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-b59426bd-e46c-4458-9470-0d73aeb46d9b admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:31.767728 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-b59426bd-e46c-4458-9470-0d73aeb46d9b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.920457 Aug 24 12:25:31.768470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 24 12:25:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:25:34.174557 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:34.176032 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-483e6921-7eaf-4d20-b7ed-5ec9ac561848 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 24 12:25:34.176032 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 12:25:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:34.662555 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-cdf5fd23-9b33-4b11-9893-e36542ce2ae0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "c1", "disk": 1}} {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:34.684313 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:25:34.684313 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: warnings.warn(msg) Aug 24 12:25:34.719295 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-cdf5fd23-9b33-4b11-9893-e36542ce2ae0 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.535173 Aug 24 12:25:34.720203 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 12:25:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:25:34.734933 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG dbcounter [-] [105636] Writing DB stats nova_api:SELECT=3 {{(pid=105636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:34.735914 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG dbcounter [-] [105636] Writing DB stats nova_cell0:SELECT=3 {{(pid=105636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:34.736950 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG dbcounter [-] [105636] Writing DB stats nova_cell1:SELECT=3 {{(pid=105636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:34.738082 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG dbcounter [-] [105636] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:35.013404 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-31ae9ca3-fd09-4335-9f2c-7c5b517c44cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:35.018407 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:25:35.018407 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: warnings.warn(msg) Aug 24 12:25:35.097712 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-31ae9ca3-fd09-4335-9f2c-7c5b517c44cd admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.369208 Aug 24 12:25:35.098317 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 24 12:25:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:25:37.517025 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-cdf5fd23-9b33-4b11-9893-e36542ce2ae0 admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:37.518062 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-cdf5fd23-9b33-4b11-9893-e36542ce2ae0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 24 12:25:37.518712 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 12:25:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:38.186542 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-6f4616c1-c5dc-427b-970f-e35da377af90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "disk": 5, "id": "d1", "ram": 512, "swap": 0}} {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:38.211134 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:25:38.211134 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: warnings.warn(msg) Aug 24 12:25:38.235491 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-6f4616c1-c5dc-427b-970f-e35da377af90 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.710576 Aug 24 12:25:38.236229 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 12:25:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:25:38.249493 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-9158fd5a-0854-42bf-848d-694e1e61d3a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:38.252634 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:25:38.252634 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: warnings.warn(msg) Aug 24 12:25:38.284739 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-9158fd5a-0854-42bf-848d-694e1e61d3a3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039763 Aug 24 12:25:38.291663 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 24 12:25:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:25:40.690408 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-6f4616c1-c5dc-427b-970f-e35da377af90 admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:40.691345 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-6f4616c1-c5dc-427b-970f-e35da377af90 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 24 12:25:40.691784 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 12:25:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:41.098167 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-6b3287b3-4d3a-4fe5-a17e-53ace3695f0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:41.117317 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-6b3287b3-4d3a-4fe5-a17e-53ace3695f0e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.419274 Aug 24 12:25:41.117875 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 12:25:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:25:41.130519 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-a7efdad1-8b57-495c-9d21-f4adcc3a7660 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:41.153880 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-a7efdad1-8b57-495c-9d21-f4adcc3a7660 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027027 Aug 24 12:25:41.154453 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 24 12:25:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:25:43.554549 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-6b3287b3-4d3a-4fe5-a17e-53ace3695f0e admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:43.556195 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-6b3287b3-4d3a-4fe5-a17e-53ace3695f0e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.008596 Aug 24 12:25:43.556768 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 12:25:43 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:44.024768 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-cfa47dd5-cf54-4a2d-9971-b35f028fbae8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:44.047199 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-cfa47dd5-cf54-4a2d-9971-b35f028fbae8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482394 Aug 24 12:25:44.049649 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 12:25:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:25:44.061033 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-ab7cbb5d-634a-4aa6-a323-eb80657e5e3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:44.087514 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-ab7cbb5d-634a-4aa6-a323-eb80657e5e3c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030826 Aug 24 12:25:44.088589 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 24 12:25:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:25:46.460443 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-cfa47dd5-cf54-4a2d-9971-b35f028fbae8 admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:46.461367 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-cfa47dd5-cf54-4a2d-9971-b35f028fbae8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 24 12:25:46.465876 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 12:25:46 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:46.917037 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-d002e3d3-565c-4a62-8c64-bd57d0a936a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "disk": 20, "vcpus": 4}} {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:46.937953 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-d002e3d3-565c-4a62-8c64-bd57d0a936a2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.469179 Aug 24 12:25:46.938731 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 12:25:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:25:46.951928 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-72c636f8-3577-4d37-be0b-ac5c4bd0641d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:46.977386 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-72c636f8-3577-4d37-be0b-ac5c4bd0641d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029750 Aug 24 12:25:46.977973 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 24 12:25:46 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:25:49.574798 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-d002e3d3-565c-4a62-8c64-bd57d0a936a2 admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:49.575909 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-d002e3d3-565c-4a62-8c64-bd57d0a936a2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Aug 24 12:25:49.576348 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 12:25:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:50.011483 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-9c0e4c54-d152-4b85-a61e-4fbfec9d7fd3 admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:50.038541 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-9c0e4c54-d152-4b85-a61e-4fbfec9d7fd3 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.455732 Aug 24 12:25:50.039145 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 24 12:25:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:25:52.516499 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-d002e3d3-565c-4a62-8c64-bd57d0a936a2 admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:52.517411 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-d002e3d3-565c-4a62-8c64-bd57d0a936a2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 24 12:25:52.517843 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 12:25:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:52.964879 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-e10da967-4e01-455d-9517-4a55fa1db370 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:52.984069 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-e10da967-4e01-455d-9517-4a55fa1db370 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.459795 Aug 24 12:25:52.984646 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 12:25:52 2022] POST /compute/v2.1/flavors => generated 402 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:25:52.997249 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-0238c08c-ece8-4c55-815c-4495ed072b99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:53.022541 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-0238c08c-ece8-4c55-815c-4495ed072b99 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029427 Aug 24 12:25:53.023125 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 24 12:25:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:25:55.395326 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-e10da967-4e01-455d-9517-4a55fa1db370 admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:55.396376 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-e10da967-4e01-455d-9517-4a55fa1db370 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 24 12:25:55.396778 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 12:25:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:55.806329 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-24149082-d8e3-42f3-a242-511dc8cb52d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:55.826088 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-24149082-d8e3-42f3-a242-511dc8cb52d5 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.422564 Aug 24 12:25:55.826564 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 12:25:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:25:55.842667 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-36cdb9a8-056b-4217-b86a-980f17fee543 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:55.866206 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-36cdb9a8-056b-4217-b86a-980f17fee543 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031080 Aug 24 12:25:55.866915 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 24 12:25:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:25:58.301488 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-24149082-d8e3-42f3-a242-511dc8cb52d5 admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:58.302544 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-24149082-d8e3-42f3-a242-511dc8cb52d5 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001874 Aug 24 12:25:58.309206 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 12:25:58 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:58.759148 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-268cb73a-8856-47e6-9a90-7eaafbcabd48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "swap": 0, "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:58.779055 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-268cb73a-8856-47e6-9a90-7eaafbcabd48 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.468462 Aug 24 12:25:58.779610 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 12:25:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:25:58.791432 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-647ac903-db09-4131-b8a6-d3f23b987ae8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:58.820889 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-647ac903-db09-4131-b8a6-d3f23b987ae8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032793 Aug 24 12:25:58.821481 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 24 12:25:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:26:01.199954 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-268cb73a-8856-47e6-9a90-7eaafbcabd48 admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:01.201623 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-268cb73a-8856-47e6-9a90-7eaafbcabd48 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002679 Aug 24 12:26:01.212508 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 12:26:01 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:01.664830 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-70e40089-fe2c-475c-8d83-cf29be1d9ef3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:01.675238 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG dbcounter [-] [105637] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:26:01.691953 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-70e40089-fe2c-475c-8d83-cf29be1d9ef3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.483209 Aug 24 12:26:01.692545 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 12:26:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:26:01.705172 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-d6e59a63-4141-4edd-82ac-3b57093521ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:01.731008 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-d6e59a63-4141-4edd-82ac-3b57093521ee admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028905 Aug 24 12:26:01.732215 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 24 12:26:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:26:04.148442 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-70e40089-fe2c-475c-8d83-cf29be1d9ef3 admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:04.150041 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-70e40089-fe2c-475c-8d83-cf29be1d9ef3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002085 Aug 24 12:26:04.150689 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 12:26:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:04.604274 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-395b8c37-b814-40da-9710-9bc1c4313437 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "swap": 0, "id": "5", "disk": 160}} {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:04.624257 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-395b8c37-b814-40da-9710-9bc1c4313437 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.466410 Aug 24 12:26:04.625106 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 12:26:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:26:04.638217 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-e449ed17-4301-4f59-a6f6-5f1e0fd77a0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:04.666468 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-e449ed17-4301-4f59-a6f6-5f1e0fd77a0f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032839 Aug 24 12:26:04.667050 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 24 12:26:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:26:23.609982 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-395b8c37-b814-40da-9710-9bc1c4313437 admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:23.610995 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-395b8c37-b814-40da-9710-9bc1c4313437 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 24 12:26:23.611400 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 12:26:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:23.622718 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG dbcounter [-] [105637] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:26:24.002228 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-c56fd58e-04e8-4c4e-b1fb-2c3ed7cfad0a admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:24.020191 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-c56fd58e-04e8-4c4e-b1fb-2c3ed7cfad0a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402713 Aug 24 12:26:24.020728 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 24 12:26:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:26:25.094858 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-395b8c37-b814-40da-9710-9bc1c4313437 admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:25.096002 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-395b8c37-b814-40da-9710-9bc1c4313437 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 24 12:26:25.096716 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:25.622857 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-1b557320-1325-4dd2-a8f9-1873219450a6 admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:25.628396 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.wsgi [None req-1b557320-1325-4dd2-a8f9-1873219450a6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-1b557320-1325-4dd2-a8f9-1873219450a6 admin admin] Request method failure captured: Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Accept: application/json Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Accept-Encoding: gzip, deflate Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Connection: keep-alive Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Content-Length: 0 Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Host: 10.222.0.58 Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Openstack-Api-Version: compute 2.90 Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Openstack-System-Scope: None Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: User-Agent: python-novaclient Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Auth-Token: gAAAAABjBhjwuu11U1OL8X_6rSdOie7HxH6Z6Dszj5_mhuYWRJkqQbXZgu7qR7yKbddMvcBGxcdDMjo9Jnzh3uAEFowk85zMBff1k8CLDAP6jI2mKutTx_fXQjsd7QiVPhism48dB1z0pfA3dMV7lV7R7FGqyaYwz9SnPcWj4Hq9VVG1yCDo8zg Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Domain-Id: None Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Domain-Name: None Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Identity-Status: Confirmed Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Is-Admin-Project: True Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Project-Domain-Id: default Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Project-Domain-Name: Default Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Project-Id: ae0194ad9d2f4f1ebdd6b4e39c18be2c Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Project-Name: admin Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Role: member,reader,admin Aug 24 12:26:25.631670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Roles: member,reader,admin Aug 24 12:26:25.633305 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:26:25.633305 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Tenant: admin Aug 24 12:26:25.633305 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Tenant-Id: ae0194ad9d2f4f1ebdd6b4e39c18be2c Aug 24 12:26:25.633305 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Tenant-Name: admin Aug 24 12:26:25.633305 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-User: admin Aug 24 12:26:25.633305 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-User-Domain-Id: default Aug 24 12:26:25.633305 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-User-Domain-Name: Default Aug 24 12:26:25.633305 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-User-Id: ec5a3f02319e4ee5bdd1b0a6b24084c2 Aug 24 12:26:25.633305 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-User-Name: admin Aug 24 12:26:25.633305 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: method: > Aug 24 12:26:25.633305 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: exception: Flavor 42 could not be found. Aug 24 12:26:25.633305 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: action_args: {'id': '42'} Aug 24 12:26:25.633305 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:26:25.633305 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:25.634330 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Aug 24 12:26:25.636401 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-1b557320-1325-4dd2-a8f9-1873219450a6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:26:25.637743 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-1b557320-1325-4dd2-a8f9-1873219450a6 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.395591 Aug 24 12:26:25.637743 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 24 12:26:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:26:25.643406 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-fabfd3a5-8062-40bc-a8b9-22092e4151dd admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:25.647549 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG dbcounter [-] [105636] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:26:25.668428 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-fabfd3a5-8062-40bc-a8b9-22092e4151dd admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028632 Aug 24 12:26:25.668981 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 24 12:26:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:26:25.678732 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-f5ad09f8-bca5-4da2-948c-8b4d2cae25a1 admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:25.702548 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-f5ad09f8-bca5-4da2-948c-8b4d2cae25a1 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027419 Aug 24 12:26:25.703084 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 24 12:26:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:26:25.712573 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-11af14fc-4643-4597-bded-ea289380038d admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:25.720032 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.wsgi [None req-11af14fc-4643-4597-bded-ea289380038d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-11af14fc-4643-4597-bded-ea289380038d admin admin] Request method failure captured: Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Accept: application/json Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Accept-Encoding: gzip, deflate Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Connection: keep-alive Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Content-Length: 0 Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Host: 10.222.0.58 Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Openstack-Api-Version: compute 2.90 Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Openstack-System-Scope: None Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: User-Agent: python-novaclient Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Auth-Token: gAAAAABjBhjwuu11U1OL8X_6rSdOie7HxH6Z6Dszj5_mhuYWRJkqQbXZgu7qR7yKbddMvcBGxcdDMjo9Jnzh3uAEFowk85zMBff1k8CLDAP6jI2mKutTx_fXQjsd7QiVPhism48dB1z0pfA3dMV7lV7R7FGqyaYwz9SnPcWj4Hq9VVG1yCDo8zg Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Domain-Id: None Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Domain-Name: None Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Identity-Status: Confirmed Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Is-Admin-Project: True Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Project-Domain-Id: default Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Project-Domain-Name: Default Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Project-Id: ae0194ad9d2f4f1ebdd6b4e39c18be2c Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Project-Name: admin Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Role: member,reader,admin Aug 24 12:26:25.723287 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Roles: member,reader,admin Aug 24 12:26:25.724856 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:26:25.724856 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Tenant: admin Aug 24 12:26:25.724856 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Tenant-Id: ae0194ad9d2f4f1ebdd6b4e39c18be2c Aug 24 12:26:25.724856 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Tenant-Name: admin Aug 24 12:26:25.724856 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-User: admin Aug 24 12:26:25.724856 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-User-Domain-Id: default Aug 24 12:26:25.724856 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-User-Domain-Name: Default Aug 24 12:26:25.724856 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-User-Id: ec5a3f02319e4ee5bdd1b0a6b24084c2 Aug 24 12:26:25.724856 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-User-Name: admin Aug 24 12:26:25.724856 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: method: > Aug 24 12:26:25.724856 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: exception: Flavor 42 could not be found. Aug 24 12:26:25.724856 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: action_args: {'id': '42'} Aug 24 12:26:25.724856 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:26:25.724856 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:25.725654 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Aug 24 12:26:25.726714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-11af14fc-4643-4597-bded-ea289380038d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:26:25.727800 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-11af14fc-4643-4597-bded-ea289380038d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015759 Aug 24 12:26:25.727800 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 24 12:26:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:26:26.693921 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-f5ad09f8-bca5-4da2-948c-8b4d2cae25a1 admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:26.695034 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-f5ad09f8-bca5-4da2-948c-8b4d2cae25a1 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Aug 24 12:26:26.695459 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:27.241806 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-9d63f157-88a0-4983-abfd-99395d3ad0b9 admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:27.247714 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.wsgi [None req-9d63f157-88a0-4983-abfd-99395d3ad0b9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-9d63f157-88a0-4983-abfd-99395d3ad0b9 admin admin] Request method failure captured: Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Accept: application/json Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Accept-Encoding: gzip, deflate Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Connection: keep-alive Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Content-Length: 0 Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Host: 10.222.0.58 Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Openstack-Api-Version: compute 2.90 Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Openstack-System-Scope: None Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: User-Agent: python-novaclient Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Auth-Token: gAAAAABjBhjymXrAW8Fjync18GIReN9oobzHMJmQOCeAgQIEvvIfF6ynpjkE1BbUqvTo1r0QXSJq1mx0TihPxDpGmW36WGnMGlUSG5QpxrREL0ENjnuA7K5OR2p00xjmIWbQcr9zoymc2KX5CDvZYh7kFKLrdlOR7ev77UE_C8CoBmC2i8Y0W6U Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Domain-Id: None Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Domain-Name: None Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Identity-Status: Confirmed Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Is-Admin-Project: True Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Project-Domain-Id: default Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Project-Domain-Name: Default Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Project-Id: ae0194ad9d2f4f1ebdd6b4e39c18be2c Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Project-Name: admin Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Role: member,reader,admin Aug 24 12:26:27.249464 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Roles: member,reader,admin Aug 24 12:26:27.251035 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:26:27.251035 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Tenant: admin Aug 24 12:26:27.251035 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Tenant-Id: ae0194ad9d2f4f1ebdd6b4e39c18be2c Aug 24 12:26:27.251035 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Tenant-Name: admin Aug 24 12:26:27.251035 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-User: admin Aug 24 12:26:27.251035 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-User-Domain-Id: default Aug 24 12:26:27.251035 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-User-Domain-Name: Default Aug 24 12:26:27.251035 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-User-Id: ec5a3f02319e4ee5bdd1b0a6b24084c2 Aug 24 12:26:27.251035 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-User-Name: admin Aug 24 12:26:27.251035 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: method: > Aug 24 12:26:27.251035 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: exception: Flavor 84 could not be found. Aug 24 12:26:27.251035 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: action_args: {'id': '84'} Aug 24 12:26:27.251035 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:26:27.251035 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:27.251945 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Aug 24 12:26:27.253023 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-9d63f157-88a0-4983-abfd-99395d3ad0b9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:26:27.254060 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-9d63f157-88a0-4983-abfd-99395d3ad0b9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.405024 Aug 24 12:26:27.254060 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 24 12:26:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:26:27.260789 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-c2ddf7d7-353a-4860-93e3-12ba6218d533 admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:27.275732 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-c2ddf7d7-353a-4860-93e3-12ba6218d533 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018574 Aug 24 12:26:27.276272 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 24 12:26:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:26:27.285712 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-7703a3c8-fabd-41af-8e49-67724494191c admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:27.301186 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-7703a3c8-fabd-41af-8e49-67724494191c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018993 Aug 24 12:26:27.301705 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 24 12:26:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:26:27.311759 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-1f4a83b7-d53e-4b45-bc19-c8857ab9303e admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:27.316971 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.wsgi [None req-1f4a83b7-d53e-4b45-bc19-c8857ab9303e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-1f4a83b7-d53e-4b45-bc19-c8857ab9303e admin admin] Request method failure captured: Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Accept: application/json Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Accept-Encoding: gzip, deflate Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Connection: keep-alive Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Content-Length: 0 Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Host: 10.222.0.58 Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Openstack-Api-Version: compute 2.90 Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Openstack-System-Scope: None Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: User-Agent: python-novaclient Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Auth-Token: gAAAAABjBhjymXrAW8Fjync18GIReN9oobzHMJmQOCeAgQIEvvIfF6ynpjkE1BbUqvTo1r0QXSJq1mx0TihPxDpGmW36WGnMGlUSG5QpxrREL0ENjnuA7K5OR2p00xjmIWbQcr9zoymc2KX5CDvZYh7kFKLrdlOR7ev77UE_C8CoBmC2i8Y0W6U Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Domain-Id: None Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Domain-Name: None Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Identity-Status: Confirmed Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Is-Admin-Project: True Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Project-Domain-Id: default Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Project-Domain-Name: Default Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Project-Id: ae0194ad9d2f4f1ebdd6b4e39c18be2c Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Project-Name: admin Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Role: member,reader,admin Aug 24 12:26:27.318470 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Roles: member,reader,admin Aug 24 12:26:27.320055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:26:27.320055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Tenant: admin Aug 24 12:26:27.320055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Tenant-Id: ae0194ad9d2f4f1ebdd6b4e39c18be2c Aug 24 12:26:27.320055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Tenant-Name: admin Aug 24 12:26:27.320055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-User: admin Aug 24 12:26:27.320055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-User-Domain-Id: default Aug 24 12:26:27.320055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-User-Domain-Name: Default Aug 24 12:26:27.320055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-User-Id: ec5a3f02319e4ee5bdd1b0a6b24084c2 Aug 24 12:26:27.320055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-User-Name: admin Aug 24 12:26:27.320055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: method: > Aug 24 12:26:27.320055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: exception: Flavor 84 could not be found. Aug 24 12:26:27.320055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: action_args: {'id': '84'} Aug 24 12:26:27.320055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:26:27.320055 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:27.321281 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Aug 24 12:26:27.322805 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-1f4a83b7-d53e-4b45-bc19-c8857ab9303e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:26:27.324720 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-1f4a83b7-d53e-4b45-bc19-c8857ab9303e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012471 Aug 24 12:26:27.324720 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 24 12:26:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:26:28.282163 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-7703a3c8-fabd-41af-8e49-67724494191c admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:28.283173 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-7703a3c8-fabd-41af-8e49-67724494191c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 24 12:26:28.283579 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:28.817187 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-33fbf143-5f0d-4e50-819f-c7b474db6a45 admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:28.823132 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.wsgi [None req-33fbf143-5f0d-4e50-819f-c7b474db6a45 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-33fbf143-5f0d-4e50-819f-c7b474db6a45 admin admin] Request method failure captured: Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Accept: application/json Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Accept-Encoding: gzip, deflate Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Connection: keep-alive Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Content-Length: 0 Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Host: 10.222.0.58 Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Openstack-Api-Version: compute 2.90 Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Openstack-System-Scope: None Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: User-Agent: python-novaclient Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Auth-Token: gAAAAABjBhj0TCCsWmJYucwWeYmpbL_ohGSTRvdCd_pH3cIedhbw7R2Qy3_e2760WgTN8ik1_bLfXmTV-awVhrtl8wRXHhtIbrFpclPFPSawXOTpKCNnC2u0ORTyZBPnQ4vJgtZ4Eh7DAJib4fw-p8mhXHQU01ON95FM42eh6Y_AiuqDWirzme0 Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Domain-Id: None Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Domain-Name: None Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Identity-Status: Confirmed Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Is-Admin-Project: True Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Project-Domain-Id: default Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Project-Domain-Name: Default Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Project-Id: ae0194ad9d2f4f1ebdd6b4e39c18be2c Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Project-Name: admin Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Role: member,reader,admin Aug 24 12:26:28.824670 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Roles: member,reader,admin Aug 24 12:26:28.826335 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:26:28.826335 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Tenant: admin Aug 24 12:26:28.826335 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Tenant-Id: ae0194ad9d2f4f1ebdd6b4e39c18be2c Aug 24 12:26:28.826335 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-Tenant-Name: admin Aug 24 12:26:28.826335 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-User: admin Aug 24 12:26:28.826335 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-User-Domain-Id: default Aug 24 12:26:28.826335 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-User-Domain-Name: Default Aug 24 12:26:28.826335 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-User-Id: ec5a3f02319e4ee5bdd1b0a6b24084c2 Aug 24 12:26:28.826335 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: X-User-Name: admin Aug 24 12:26:28.826335 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: method: > Aug 24 12:26:28.826335 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: exception: Flavor 451 could not be found. Aug 24 12:26:28.826335 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: action_args: {'id': '451'} Aug 24 12:26:28.826335 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:26:28.826335 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:28.827177 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: ERROR nova.api.openstack.wsgi Aug 24 12:26:28.828415 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-33fbf143-5f0d-4e50-819f-c7b474db6a45 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:26:28.829761 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-33fbf143-5f0d-4e50-819f-c7b474db6a45 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395471 Aug 24 12:26:28.829761 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 24 12:26:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:26:28.835533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-77e73ecd-d246-4b74-9061-7b336e141747 admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:28.850663 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-77e73ecd-d246-4b74-9061-7b336e141747 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018646 Aug 24 12:26:28.851210 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 24 12:26:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:26:28.861487 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-f537f18d-b612-44e9-bab4-f9d43ab9628b admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:28.876783 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-f537f18d-b612-44e9-bab4-f9d43ab9628b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018790 Aug 24 12:26:28.878867 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 24 12:26:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:26:28.887112 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-36721218-b31c-4417-8edb-9d17c58b097f admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:28.892490 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.wsgi [None req-36721218-b31c-4417-8edb-9d17c58b097f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-36721218-b31c-4417-8edb-9d17c58b097f admin admin] Request method failure captured: Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Accept: application/json Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Accept-Encoding: gzip, deflate Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Connection: keep-alive Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Content-Length: 0 Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Host: 10.222.0.58 Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Openstack-Api-Version: compute 2.90 Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Openstack-System-Scope: None Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: User-Agent: python-novaclient Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Auth-Token: gAAAAABjBhj0TCCsWmJYucwWeYmpbL_ohGSTRvdCd_pH3cIedhbw7R2Qy3_e2760WgTN8ik1_bLfXmTV-awVhrtl8wRXHhtIbrFpclPFPSawXOTpKCNnC2u0ORTyZBPnQ4vJgtZ4Eh7DAJib4fw-p8mhXHQU01ON95FM42eh6Y_AiuqDWirzme0 Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Domain-Id: None Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Domain-Name: None Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Identity-Status: Confirmed Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Is-Admin-Project: True Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Project-Domain-Id: default Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Project-Domain-Name: Default Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Project-Id: ae0194ad9d2f4f1ebdd6b4e39c18be2c Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Project-Name: admin Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Role: member,reader,admin Aug 24 12:26:28.893986 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Roles: member,reader,admin Aug 24 12:26:28.895533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ae0194ad9d2f4f1ebdd6b4e39c18be2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:26:28.895533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Tenant: admin Aug 24 12:26:28.895533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Tenant-Id: ae0194ad9d2f4f1ebdd6b4e39c18be2c Aug 24 12:26:28.895533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-Tenant-Name: admin Aug 24 12:26:28.895533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-User: admin Aug 24 12:26:28.895533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-User-Domain-Id: default Aug 24 12:26:28.895533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-User-Domain-Name: Default Aug 24 12:26:28.895533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-User-Id: ec5a3f02319e4ee5bdd1b0a6b24084c2 Aug 24 12:26:28.895533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: X-User-Name: admin Aug 24 12:26:28.895533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: method: > Aug 24 12:26:28.895533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: exception: Flavor 451 could not be found. Aug 24 12:26:28.895533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: action_args: {'id': '451'} Aug 24 12:26:28.895533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:26:28.895533 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:28.896439 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: ERROR nova.api.openstack.wsgi Aug 24 12:26:28.897514 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-36721218-b31c-4417-8edb-9d17c58b097f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:26:28.898579 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-36721218-b31c-4417-8edb-9d17c58b097f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012124 Aug 24 12:26:28.898579 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 24 12:26:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:26:29.857590 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-f537f18d-b612-44e9-bab4-f9d43ab9628b admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:29.858669 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-f537f18d-b612-44e9-bab4-f9d43ab9628b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Aug 24 12:26:29.859070 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:30.384820 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-f33026dc-b1c1-40ac-872f-0037c07a161e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:30.403589 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-f33026dc-b1c1-40ac-872f-0037c07a161e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.406667 Aug 24 12:26:30.404097 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 24 12:26:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:26:31.372867 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-f537f18d-b612-44e9-bab4-f9d43ab9628b admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:31.373870 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-f537f18d-b612-44e9-bab4-f9d43ab9628b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 24 12:26:31.374265 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:31.896574 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-4785fe8d-db22-480f-8d6c-bc2a4723d6ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:31.915510 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-4785fe8d-db22-480f-8d6c-bc2a4723d6ba admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.404279 Aug 24 12:26:31.916116 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 24 12:26:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:26:32.904090 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-f537f18d-b612-44e9-bab4-f9d43ab9628b admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:32.905108 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-f537f18d-b612-44e9-bab4-f9d43ab9628b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 24 12:26:32.905504 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:33.435528 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-9a4c028e-92bf-4272-9017-a36de5df77ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:33.457996 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-9a4c028e-92bf-4272-9017-a36de5df77ba admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.414540 Aug 24 12:26:33.458582 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 24 12:26:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:26:34.442980 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-f537f18d-b612-44e9-bab4-f9d43ab9628b admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:34.444028 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-f537f18d-b612-44e9-bab4-f9d43ab9628b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 24 12:26:34.444432 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:34.978197 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-acb1e85f-c085-4c82-88f7-e3addc8559e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:34.997206 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-acb1e85f-c085-4c82-88f7-e3addc8559e1 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.413385 Aug 24 12:26:34.997690 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 24 12:26:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:26:36.128577 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-f537f18d-b612-44e9-bab4-f9d43ab9628b admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:36.129673 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-f537f18d-b612-44e9-bab4-f9d43ab9628b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 Aug 24 12:26:36.130042 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:36.673523 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-06226d73-ea09-4fc6-a1e8-8b43ed886c65 admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:36.694687 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-06226d73-ea09-4fc6-a1e8-8b43ed886c65 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.412343 Aug 24 12:26:36.695233 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Wed Aug 24 12:26:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:27:30.123878 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-f537f18d-b612-44e9-bab4-f9d43ab9628b admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:30.124827 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-f537f18d-b612-44e9-bab4-f9d43ab9628b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 24 12:27:30.125240 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 12:27:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:27:30.135545 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG dbcounter [-] [105636] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:27:30.522604 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-be777a27-f257-454c-a5ca-1a7252b79060 admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:30.543915 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-be777a27-f257-454c-a5ca-1a7252b79060 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.412700 Aug 24 12:27:30.544468 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 24 12:27:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:27:30.564976 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG dbcounter [-] [105637] Writing DB stats nova_api:SELECT=14 {{(pid=105637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:27:30.568782 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-4f491190-4fad-4a1d-8a87-87d66c36c87d admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:30.576606 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-4f491190-4fad-4a1d-8a87-87d66c36c87d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013055 Aug 24 12:27:30.577126 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1283 bytes} [Wed Aug 24 12:27:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:27:30.588437 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-fb458ce6-69bf-444f-aed5-d2a4bbe8d409 admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:30.596573 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-fb458ce6-69bf-444f-aed5-d2a4bbe8d409 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011666 Aug 24 12:27:30.597091 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1286 bytes} [Wed Aug 24 12:27:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:27:30.608677 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-3de9aa17-70af-4657-bd84-38a61b1a22dd admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:30.615988 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-3de9aa17-70af-4657-bd84-38a61b1a22dd admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011371 Aug 24 12:27:30.616505 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1286 bytes} [Wed Aug 24 12:27:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:27:30.627477 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-ad546b00-37ef-4fec-b71f-fc949e32953f admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:30.634892 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-ad546b00-37ef-4fec-b71f-fc949e32953f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010892 Aug 24 12:27:30.635401 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1283 bytes} [Wed Aug 24 12:27:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:28.559095 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-3de9aa17-70af-4657-bd84-38a61b1a22dd admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:28.560872 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-3de9aa17-70af-4657-bd84-38a61b1a22dd admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002202 Aug 24 12:30:28.561277 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 12:30:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:28.706919 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG dbcounter [-] [105636] Writing DB stats nova_api:SELECT=6 {{(pid=105636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:29.001521 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-b01cbea5-b9a2-4749-ac51-1fa6eac0689d admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:29.003906 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:30:29.003906 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: warnings.warn(msg) Aug 24 12:30:29.005035 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-b01cbea5-b9a2-4749-ac51-1fa6eac0689d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:29.005502 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-b01cbea5-b9a2-4749-ac51-1fa6eac0689d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:29.005941 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-b01cbea5-b9a2-4749-ac51-1fa6eac0689d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:29.006678 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-b01cbea5-b9a2-4749-ac51-1fa6eac0689d admin admin] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:29.007113 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-b01cbea5-b9a2-4749-ac51-1fa6eac0689d admin admin] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:29.007547 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-b01cbea5-b9a2-4749-ac51-1fa6eac0689d admin admin] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:29.043142 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-b01cbea5-b9a2-4749-ac51-1fa6eac0689d admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.337236 Aug 24 12:30:29.043649 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 24 12:30:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:30:29.894537 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-3de9aa17-70af-4657-bd84-38a61b1a22dd admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:29.895588 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-3de9aa17-70af-4657-bd84-38a61b1a22dd admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 24 12:30:29.896021 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 12:30:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:30.102521 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-8ecbe169-73c8-4400-acda-7babc933616f admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:30.104932 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:30:30.104932 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: warnings.warn(msg) Aug 24 12:30:30.106026 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-8ecbe169-73c8-4400-acda-7babc933616f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:30.106656 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-8ecbe169-73c8-4400-acda-7babc933616f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:30.107090 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-8ecbe169-73c8-4400-acda-7babc933616f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:30.107902 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-8ecbe169-73c8-4400-acda-7babc933616f admin admin] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:30.108278 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-8ecbe169-73c8-4400-acda-7babc933616f admin admin] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:30.108731 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-8ecbe169-73c8-4400-acda-7babc933616f admin admin] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:30.128574 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-8ecbe169-73c8-4400-acda-7babc933616f admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.088631 Aug 24 12:30:30.129153 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 24 12:30:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:30:41.375940 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-3de9aa17-70af-4657-bd84-38a61b1a22dd admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:41.376957 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-3de9aa17-70af-4657-bd84-38a61b1a22dd admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 24 12:30:41.377358 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 36/73] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 12:30:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:41.526764 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG dbcounter [-] [105636] Writing DB stats nova_cell0:SELECT=4 {{(pid=105636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:41.527490 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG dbcounter [-] [105636] Writing DB stats nova_cell1:SELECT=4 {{(pid=105636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:41.528113 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG dbcounter [-] [105636] Writing DB stats nova_api:SELECT=8 {{(pid=105636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:41.576332 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-2e0b1ce7-587b-4c78-8d12-2bdcd8151420 admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:41.579027 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:30:41.579027 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: warnings.warn(msg) Aug 24 12:30:41.580187 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-2e0b1ce7-587b-4c78-8d12-2bdcd8151420 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:41.580662 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-2e0b1ce7-587b-4c78-8d12-2bdcd8151420 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:41.581097 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-2e0b1ce7-587b-4c78-8d12-2bdcd8151420 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:41.581813 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-2e0b1ce7-587b-4c78-8d12-2bdcd8151420 admin admin] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:41.582259 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-2e0b1ce7-587b-4c78-8d12-2bdcd8151420 admin admin] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:41.582680 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-2e0b1ce7-587b-4c78-8d12-2bdcd8151420 admin admin] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:41.607309 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-2e0b1ce7-587b-4c78-8d12-2bdcd8151420 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084867 Aug 24 12:30:41.607828 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 38/74] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 24 12:30:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:42.438334 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: DEBUG nova.api.openstack.wsgi [None req-3de9aa17-70af-4657-bd84-38a61b1a22dd admin admin] Calling method '>' {{(pid=105637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:42.439338 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: INFO nova.api.openstack.requestlog [None req-3de9aa17-70af-4657-bd84-38a61b1a22dd admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 24 12:30:42.439773 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: [pid: 105637|app: 0|req: 37/75] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 12:30:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:42.635473 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG nova.api.openstack.wsgi [None req-592536a8-6763-4fc7-9dd5-1c37e7da8a7e admin admin] Calling method '>' {{(pid=105636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:42.637905 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:30:42.637905 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: warnings.warn(msg) Aug 24 12:30:42.639006 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-592536a8-6763-4fc7-9dd5-1c37e7da8a7e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:42.639481 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-592536a8-6763-4fc7-9dd5-1c37e7da8a7e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:42.639943 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-592536a8-6763-4fc7-9dd5-1c37e7da8a7e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:42.641245 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-592536a8-6763-4fc7-9dd5-1c37e7da8a7e admin admin] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:42.641692 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-592536a8-6763-4fc7-9dd5-1c37e7da8a7e admin admin] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:42.642112 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: DEBUG oslo_concurrency.lockutils [None req-592536a8-6763-4fc7-9dd5-1c37e7da8a7e admin admin] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:42.664173 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: INFO nova.api.openstack.requestlog [None req-592536a8-6763-4fc7-9dd5-1c37e7da8a7e admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079762 Aug 24 12:30:42.664664 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: [pid: 105636|app: 0|req: 39/76] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 24 12:30:42 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:39.073249 dv-cinder-848900-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 12:31:39.074543 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: Wed Aug 24 12:31:39 2022 - graceful shutdown triggered... Aug 24 12:31:39.075020 dv-cinder-848900-5-iscsi devstack@n-api.service[105636]: Gracefully killing worker 1 (pid: 105636)... Aug 24 12:31:39.075391 dv-cinder-848900-5-iscsi devstack@n-api.service[105637]: Gracefully killing worker 2 (pid: 105637)... Aug 24 12:31:40.075708 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: worker 1 buried after 1 seconds Aug 24 12:31:40.076273 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: worker 2 buried after 1 seconds Aug 24 12:31:40.076273 dv-cinder-848900-5-iscsi devstack@n-api.service[105635]: goodbye to uWSGI. Aug 24 12:31:40.077687 dv-cinder-848900-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 12:31:40.078865 dv-cinder-848900-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 12:31:40.081988 dv-cinder-848900-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 12:31:40.091177 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 12:31:40.093205 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 12:31:40 2022] *** Aug 24 12:31:40.093373 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 12:31:40.093522 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 12:31:40.093522 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: nodename: dv-cinder-848900-5-iscsi Aug 24 12:31:40.093522 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: machine: x86_64 Aug 24 12:31:40.093522 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: clock source: unix Aug 24 12:31:40.093522 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: pcre jit disabled Aug 24 12:31:40.093522 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: detected number of CPU cores: 4 Aug 24 12:31:40.093522 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: current working directory: / Aug 24 12:31:40.093522 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: detected binary path: /usr/bin/uwsgi-core Aug 24 12:31:40.093522 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: your processes number limit is 47680 Aug 24 12:31:40.094792 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: your memory page size is 4096 bytes Aug 24 12:31:40.094792 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: detected max file descriptor number: 2048 Aug 24 12:31:40.094792 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: lock engine: pthread robust mutexes Aug 24 12:31:40.094792 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: thunder lock: enabled Aug 24 12:31:40.094792 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 12:31:40.095094 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 12:31:40.133781 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: Python main interpreter initialized at 0x55f01a2e29c0 Aug 24 12:31:40.133781 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: python threads support enabled Aug 24 12:31:40.133781 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: your server socket listen backlog is limited to 100 connections Aug 24 12:31:40.133781 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: your mercy for graceful operations on workers is 90 seconds Aug 24 12:31:40.134172 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 12:31:40.134172 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: *** Operational MODE: preforking *** Aug 24 12:31:40.134446 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: *** uWSGI is running in multiple interpreter mode *** Aug 24 12:31:40.134446 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: spawned uWSGI master process (pid: 127298) Aug 24 12:31:40.134640 dv-cinder-848900-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 12:31:40.135720 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: spawned uWSGI worker 1 (pid: 127307, cores: 1) Aug 24 12:31:40.136057 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: spawned uWSGI worker 2 (pid: 127308, cores: 1) Aug 24 12:31:40.136361 dv-cinder-848900-5-iscsi devstack@n-api.service[127298]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 12:31:40.822374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 12:31:40.829439 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 12:31:42.072970 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:31:42.072970 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: from cryptography.utils import int_from_bytes Aug 24 12:31:42.073602 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:31:42.073602 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: from cryptography.utils import int_from_bytes Aug 24 12:31:42.113478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:31:42.113478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: from cryptography.utils import int_from_bytes Aug 24 12:31:42.114183 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:31:42.114183 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: from cryptography.utils import int_from_bytes Aug 24 12:31:44.541018 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 12:31:44.541690 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 12:31:44.541797 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 12:31:44.542182 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 12:31:44.542446 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 12:31:44.542847 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.543184 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.543512 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.543864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.544351 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.544672 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.545007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.545333 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.545671 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.545939 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.546265 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.546601 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-5-iscsi {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.547597 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.547969 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.548360 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.548704 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.549021 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.549356 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.549673 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.550183 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.551564 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.551564 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.551564 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.552002 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 12:31:44.552387 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.552478 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 12:31:44.552552 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.552552 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.552857 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 12:31:44.552977 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.553166 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.553432 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 12:31:44.553552 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.553724 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 12:31:44.553829 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.554097 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.554233 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-5-iscsi {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.554425 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.554544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.554742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.554861 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.555062 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.555191 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.555525 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.555824 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.556069 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.556314 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.556538 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.556769 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.556979 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.557223 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.557449 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.557655 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.557655 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.558105 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.558323 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.558501 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.558686 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-5-iscsi {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.558882 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.559047 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.559190 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.559369 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.559517 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.559687 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.559845 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.560027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.560173 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.560314 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.560464 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.560605 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.560759 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.560907 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.561070 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.561070 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.561404 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.561569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.561719 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.561869 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.562022 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.562172 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.562313 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.562526 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.563188 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.563351 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.563498 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.563690 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.563840 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.564066 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.564225 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.564375 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.564531 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.564531 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.564825 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.564825 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.565116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.565265 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.566142 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-5-iscsi {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.566313 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.566467 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.566616 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.566759 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.566907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.567049 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.567198 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.567347 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.567512 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.567713 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.568646 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.568818 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.568980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.569137 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.569289 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.569439 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.569582 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.569739 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.569893 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.570035 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.570177 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.570317 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.570466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.570633 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.570786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.570970 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.571178 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.571325 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.571476 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.571664 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.571816 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.571960 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.572113 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.572263 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.572405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.572571 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.572712 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.572863 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.572863 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.573140 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.573140 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.573422 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.573563 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.573704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.573704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.573980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.574135 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.574135 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.574432 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.574588 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.574588 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.574873 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.575014 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.575157 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.575304 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.575304 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.576416 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.576593 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.576593 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.576886 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.577029 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.577029 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.577029 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.578424 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.578664 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.578926 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.579223 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.579223 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.579519 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.579704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.579704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.579983 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.580136 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.580136 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.580424 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.580574 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.580574 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.580860 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.581001 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.581001 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.581292 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.581436 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.581436 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.581718 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.581866 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.582028 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.582179 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.582179 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.582458 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.582605 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.582605 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.582880 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.583029 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.583029 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.583305 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.583448 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.583448 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.583752 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.584001 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.584001 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.584287 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.584436 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.584436 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.584740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.584883 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.584883 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.585158 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.585298 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.585298 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.585590 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.585857 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.585857 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.587280 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.587440 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.587440 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.587759 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.587904 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.588046 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.588195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.588344 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.588344 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.588625 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.588775 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.588937 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.589093 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.589241 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.589389 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.589538 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.589685 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.589836 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.589977 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.590125 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.590125 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.590410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.590551 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.590699 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.590859 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.591007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.591157 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.591297 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.591438 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.591587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.591764 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.591916 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.592070 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.592212 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.592359 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.592507 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.592656 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.592813 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.592969 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.593118 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.593259 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.593407 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.593556 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.593760 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.593968 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.594267 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.594415 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.594557 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.594713 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.594874 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.595028 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.595178 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.595320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.595461 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.595612 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.595932 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.596524 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.596687 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.596830 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.596998 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.597233 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.597492 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.597641 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.597803 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.597953 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.598097 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.598246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.598246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.598524 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.598665 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.598805 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.598953 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.599107 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.599251 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.599392 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.599543 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:44.599717 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.599873 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.600024 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.600166 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.600320 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.600462 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.600610 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.600762 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.600912 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.601060 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.601217 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.601376 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.601525 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.601676 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.601824 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.601974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.602115 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.602255 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.602397 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.602546 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.602726 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.602875 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.603016 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.603166 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.603325 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.603468 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.603669 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.603822 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.603975 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.604118 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.604258 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.604399 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.604554 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.604710 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.604855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.605004 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.605153 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.605312 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.605463 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.605605 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.605753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.605902 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.606141 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.606722 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.606896 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.607040 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.607189 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.607496 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.607757 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.607921 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.608076 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.608228 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.608370 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.608518 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.608661 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.608810 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.608952 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.609101 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.609250 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.610559 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.610877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.611055 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.611215 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.611366 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.611509 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.611684 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.611844 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.611997 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.612146 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.612299 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.612299 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.612575 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.612575 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.612937 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.613079 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.613278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.613436 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.613586 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.613737 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.613880 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.614028 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.614176 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.614325 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.614466 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.614616 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.614769 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.614920 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.615061 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.615211 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.615352 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.615506 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.615723 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.615885 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.616037 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.616277 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.616867 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.617072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.617230 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.617382 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.617666 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.617927 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.618105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.618250 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.618400 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.618553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.618701 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.618849 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.619000 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.619149 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.619291 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.619439 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.619579 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.619769 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.619932 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.620083 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.620225 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.620374 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.620522 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.620664 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.620813 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.620975 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.621202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.621350 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.621491 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.621641 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.621784 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.621944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.622093 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.622244 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.622387 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.622542 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.622695 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.622836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.622977 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.623126 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.623275 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.623275 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.623559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.623559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.623864 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.623864 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.624132 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.624290 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.624433 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.624585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.624743 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.624900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.625621 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.625809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.626037 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.626195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.626447 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.627074 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.627243 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.627388 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.627531 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.627837 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.627991 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.628144 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.628403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.628555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.628698 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.628839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.628988 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.629167 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.629322 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.629464 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.629605 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.629754 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.629895 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.630046 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.630195 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.630343 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.630484 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.630634 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.630784 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.630939 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.631092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.631242 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.631384 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.631532 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.631705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.631863 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.631863 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.632149 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.632291 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.632439 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.632589 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.632731 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.632880 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.633038 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.633187 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.633336 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.633490 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.633640 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.633902 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.634085 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.634275 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.634463 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.634651 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.634843 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.635036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.635216 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.635405 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.635592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.635824 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.636015 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.636203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.636486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.636780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.637323 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.637517 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.637698 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.638021 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.638213 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.638535 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.638746 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.638934 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.639105 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.639251 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.639393 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.639535 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.639707 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.639864 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.640006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.640148 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.640303 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.640445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.640638 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.640792 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.640944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.641086 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.641235 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.641376 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.641525 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.641666 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.641666 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.641948 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.642089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.642318 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.642485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.642647 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.642789 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.642937 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.643087 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.643245 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.643394 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.643535 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.643712 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.643870 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.644012 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.644163 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.644305 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.644446 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.644608 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.644762 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.644909 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.645139 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.645291 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.645440 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.646321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.646495 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.646721 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.646944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.647454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.647635 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.647790 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.647945 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.648210 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.648370 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.648513 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.648760 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.648917 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.649067 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.649223 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.649365 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.649514 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.649656 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.649804 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.649804 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.650094 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.650236 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.650378 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.650519 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.650660 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.650808 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.650959 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.651107 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.651255 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.651397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.651545 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.651759 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.651923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.652065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.652213 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.652355 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.652495 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.652651 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.652800 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.652941 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.653082 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.653223 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.653363 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.653514 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.653655 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.653817 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.653966 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.654115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.654263 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.654419 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.654561 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.654709 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.654856 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.654998 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.655148 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.655298 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.655446 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.655595 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.655781 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.655947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.656206 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.656375 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.656533 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.656700 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.656933 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.657097 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.657626 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.657785 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.657936 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.658085 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.658351 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.658520 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.658684 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.658942 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.659106 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.659256 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.659411 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.659569 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.659569 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.659924 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.660083 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.660232 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.660391 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.660556 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.660725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.660881 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.661039 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.661187 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.661341 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.661503 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.661651 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.661806 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.662025 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.662177 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.662331 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.662492 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.662652 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.662809 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.662957 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.663105 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.663260 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.663408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.663555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.663738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.663889 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.664055 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.664241 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.664631 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.664804 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.664967 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.665115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.665265 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.665423 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.665573 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.665721 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.665876 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.666041 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.666222 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.666449 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.666603 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.666760 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.666928 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.667172 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.667358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.667867 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.667867 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.668155 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.668305 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.668559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.668737 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.668898 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.669150 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.669305 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.669456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.669616 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.669775 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.669932 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.670081 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.670236 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.670394 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.670553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.670702 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.670850 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.671174 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.671579 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.672301 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.672460 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.672721 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.672995 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.673245 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.673416 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.673574 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.673725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.673888 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.674039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.674193 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.674342 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.674490 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.674646 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.674804 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.674965 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.675119 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.675282 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.675432 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.675579 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.675768 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.675919 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.676081 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.676237 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.676394 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.676647 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.676820 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.676977 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.677167 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.677406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.677903 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.678080 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.678281 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.678437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.678603 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.678893 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.679050 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.679371 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.679530 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.679750 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.679929 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.680079 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.680227 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.680389 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.680546 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.680695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.680850 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.681007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.681164 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.681324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.681473 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.681579 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.681671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.681752 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.681838 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.681927 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.682013 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.682099 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.682184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.682277 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.682394 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.682482 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.682575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.682662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.682754 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.682754 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.682925 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.682925 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.683084 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.683170 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.683263 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.683359 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.683446 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.683539 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.683642 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.683730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.683828 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.683924 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.684012 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.684099 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.684184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.684270 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.684355 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.684515 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.684605 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.684691 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.684776 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.684862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.684947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.685045 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.685137 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.685230 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.685317 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.685410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.685497 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.685596 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.685683 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.685768 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.685861 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.685955 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.686051 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.686140 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.686232 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.686326 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.686414 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.686499 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.687232 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.687343 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.687556 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.688599 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.688599 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.688749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.688850 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.688962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.689058 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.689152 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.689240 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.689533 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.689642 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.689743 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.689831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.689918 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.690004 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.690102 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.690190 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.690276 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.690370 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.690464 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.690551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.690646 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.690646 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.690646 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.690646 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.690646 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.690646 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.690646 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.691191 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.691285 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.691285 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.691285 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.691285 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.691285 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.691285 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.691774 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.691867 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.691867 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.691867 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.691867 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.691867 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.692256 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.692342 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.692435 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.692531 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.692531 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.692688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.692774 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.692867 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.692954 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.692954 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.692954 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693190 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693275 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693275 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693275 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693275 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693275 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693275 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693751 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693837 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693837 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693837 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693837 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693837 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693837 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693837 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.693837 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.694467 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.694554 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.694554 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.694719 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.694920 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.695149 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.695247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.695534 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.695759 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.695866 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.696171 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.696700 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.696827 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.696918 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.697005 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.697101 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.697375 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.697486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.697685 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.697997 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.698096 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.698630 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.698751 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.698841 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.698936 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.699131 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.699226 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.699683 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.699845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.699954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.700155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.700463 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.700562 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.700768 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.701076 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.701176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.701383 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.701666 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.701824 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.702388 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.702595 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.702689 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.703013 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.703313 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.703407 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.703711 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.703967 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.704073 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.704333 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.704581 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.704680 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.705050 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.705150 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.705798 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.705920 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.706011 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.706011 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.706172 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.706260 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.706550 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.706751 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.706844 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.707172 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.707381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.707495 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.707788 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.707931 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.708096 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.708560 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.709317 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.709427 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.709517 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.709611 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.709889 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.710002 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.710002 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.710170 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.710258 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.710558 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.710659 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.710901 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.711177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.711282 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.711501 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.711820 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.711939 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.712242 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.712430 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.712547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.712863 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.713042 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.713212 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.713488 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.713615 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.713814 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.714125 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.714218 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.714442 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.714717 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.714820 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.715060 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.715310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.715411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.715703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.715930 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.716035 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.716430 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.716529 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.716754 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.717021 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.717800 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.717901 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.717997 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.718093 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.718196 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.718196 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.718355 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.718698 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.719015 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.719015 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.719186 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.719514 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.719695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.720028 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.720195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.720288 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.720511 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.720771 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.720880 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.721122 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.721357 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.721460 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.721725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.721977 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.722092 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.722346 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.722566 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.722670 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.722974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.723144 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.723746 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.723871 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.723969 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.723969 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.724220 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.724324 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.724550 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.724815 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.724917 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.725147 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.725400 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.725502 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.725781 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.726088 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.726181 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.726409 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.726685 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.726788 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.727060 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.727290 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.727385 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.727787 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.728011 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.728121 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.728342 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.728648 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.729091 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.729091 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.729272 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.729361 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.729549 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.729752 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.729854 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.730163 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.730392 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.730498 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.730736 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.730916 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.731042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.731344 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.731634 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.731748 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.731948 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.732256 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.732352 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.732970 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.733064 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.733161 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.733161 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.733450 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.733552 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.733776 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.734047 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.734787 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.734942 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.735273 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.735535 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.735760 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.736036 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.736182 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.736434 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.736586 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.736740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.737021 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.737168 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.737356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.737533 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.737701 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.737977 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.738139 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.738288 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.738505 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.738646 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.739267 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.739428 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.739576 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.739738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.739878 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.739878 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.740153 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.740418 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.740679 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.740831 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.740983 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.741214 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.741354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.741587 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.741725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.741902 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.742111 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.742273 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.742515 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.742668 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.742808 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.743070 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.743209 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.743416 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.743592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.743776 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.744079 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.744226 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.744405 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.744584 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.744744 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.745039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.745197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.745365 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.745556 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.745697 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.745990 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.746136 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.746518 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.746847 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.747178 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.747467 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.747590 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.747708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.747867 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.748077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.748353 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.748503 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.748646 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.748747 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.748842 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.749108 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.749298 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.749440 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.749600 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.749756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.749963 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.750832 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.750946 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.751170 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.751267 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.751577 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.751706 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.751921 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.752018 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.752243 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.752342 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.752558 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.752690 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.752878 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.752974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.753215 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.753321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.753531 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.753635 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.753853 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.753947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.754173 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.754267 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.754490 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.754596 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.754803 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.755029 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.755131 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.755345 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.755449 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.755706 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.755816 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.756036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.756130 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.756363 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.756466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.756682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.756784 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.757001 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.757103 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.757329 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.757431 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.757637 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.757729 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.757943 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.758036 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.758255 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.758374 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.758565 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.758670 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.758868 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.758972 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.759196 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.759322 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.759512 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.759611 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.759831 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.759929 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.760143 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.760243 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.760453 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.760588 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.760909 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.761078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.761249 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.761430 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.761584 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.761749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.761911 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.762076 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.762235 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.762405 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.762568 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.762727 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.762881 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.763035 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.763192 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.763360 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.763510 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.763693 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.763842 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.764002 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.764154 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.764315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.764466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.764625 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.764783 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.764931 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.765093 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.765233 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.765407 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.765582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.765896 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.765989 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.766272 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.766354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.766588 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.766680 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.766924 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.767010 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.767244 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.767335 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.767548 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.767700 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.767886 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.767978 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.768188 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.768270 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.768498 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.768606 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.768805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.768912 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.769106 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.769208 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.769641 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.769752 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.769853 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.769942 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.770030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.770117 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.770287 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.770396 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.770593 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.770709 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.770903 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.771018 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.771215 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.771337 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.771517 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.771663 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.771848 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.771991 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.772153 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.772333 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.772632 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.772734 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.772955 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.773283 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.773715 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.773885 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.774078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.774170 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.774403 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.774495 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.774719 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.774803 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.775047 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.775131 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.775363 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.775445 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.776001 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.776151 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.776268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.776388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.776502 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.776613 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.776733 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.777016 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.777355 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.777677 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.778015 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.778227 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.778463 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.778572 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.778775 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.778959 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.779123 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.779296 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.779401 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.779763 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.779867 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.779959 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.780037 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.780289 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.780409 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.780615 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.780709 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.780931 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.781030 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.781362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.781507 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.781644 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.781740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.781959 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.782073 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.782270 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.782365 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.782579 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.782681 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.782886 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.782996 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.783195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.783297 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.783503 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.783597 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.783860 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.784023 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.784181 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.784425 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.784536 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.784748 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.784859 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.785094 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.785196 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.785413 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.785512 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.785731 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.785841 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.786048 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.786156 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.786364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.786472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.786675 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.786781 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.786985 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.787078 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.787294 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.787387 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.787601 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.787850 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.787947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.788171 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.788266 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.788514 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.788618 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.788847 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.788950 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.789179 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.789288 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.789505 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.789644 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.790035 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.790137 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.790234 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.790322 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.790455 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.790558 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.790796 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.790904 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.791113 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.791206 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.791491 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.791607 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.791761 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.791857 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.792073 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.792167 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.792398 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.792492 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.792708 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.792802 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.793034 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.793137 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.793350 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.793445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.793652 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.793957 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.794057 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.794262 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.794357 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.794569 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.794664 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.794887 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.794988 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.795197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.795300 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.795500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.795601 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.795826 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.795947 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.796133 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.796281 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.796435 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.796595 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.796758 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.797467 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.797696 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.797794 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.798006 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.798098 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.798313 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.798405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.798615 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.798709 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.798918 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.799010 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.799221 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.799323 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.799526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.799673 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.799853 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.799985 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.800159 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.800268 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.800470 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.800572 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.800777 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.800872 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.801082 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.801183 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.801387 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.801489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.801690 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.801783 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.801993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.802097 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.802328 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.802434 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.802637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.802752 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.802945 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.803043 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.803265 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.803367 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.803575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.803744 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.803912 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.804013 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.804224 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.804318 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.804539 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.804702 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.804847 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.804948 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.805163 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.805270 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.805480 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.805593 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.805807 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.805914 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.806115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.806212 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.806422 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.806537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.806732 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.806851 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.807040 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.807149 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.807347 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.807451 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.807674 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.807773 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.808004 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.808099 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.808331 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.808426 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.808637 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.808739 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.808963 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.809189 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.809292 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.809530 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.809647 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.809879 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.810016 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.810323 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.810435 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.810591 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.810694 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.810910 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.811017 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.811220 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.811323 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.811525 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.811647 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.811858 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.811964 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.812166 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.812275 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.813119 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.813244 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.813409 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.813618 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.813723 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.813941 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.814046 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.814260 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.814353 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.814577 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.814684 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.814906 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.815008 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.815222 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.815310 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.815531 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.815664 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.815866 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.815958 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.816182 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.816281 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.816496 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.816589 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.816811 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.816906 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.817141 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.817245 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.817483 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.817577 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.817798 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.817897 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.818112 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.818216 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.818424 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.818531 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.818668 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 12:31:44.818769 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.819048 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.819367 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.819707 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.820027 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.820353 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.820691 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.821010 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.821321 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.821756 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.822075 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.822401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.822728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.823043 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.823373 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.823732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.824054 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.824384 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.824704 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.825041 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.825391 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.825730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.826063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.826375 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.826688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.827000 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.827573 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.827925 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.828270 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.828643 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.828989 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.829308 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.829618 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.829928 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.830239 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.830553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.830864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.831173 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.831481 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.831815 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.832127 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.832434 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.832744 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.833059 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.833370 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.833678 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.833986 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.834294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.834601 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.834941 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.835285 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.835614 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.835967 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.836288 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.836619 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.836935 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.837266 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.837595 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.837920 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.838238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.838576 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.838891 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.839205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.839521 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.839860 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.840174 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.840499 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.840821 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.841153 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.841465 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.841797 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.842121 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.842446 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.842767 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.843083 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.843448 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.843820 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.844144 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.844456 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.844771 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.845085 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.845410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.845722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.846037 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.846358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.846678 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.847012 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.847344 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.847677 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.848013 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.848347 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.848701 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.849018 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.849373 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.849711 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.850036 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.850356 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.850672 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:44.850956 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 12:31:44.880923 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO dbcounter [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] Registered counter for database nova_api Aug 24 12:31:44.900955 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_db.sqlalchemy.engines [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:31:44.908124 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writer thread running {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:31:44.914066 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO dbcounter [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] Registered counter for database nova_api Aug 24 12:31:44.934903 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_db.sqlalchemy.engines [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127308) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:31:44.941557 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writer thread running {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:31:44.963743 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.context [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87459494-59a1-454d-a2fa-293053432209(cell1) {{(pid=127307) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 12:31:44.967869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:44.968344 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:44.970476 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:44.971216 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:44.971684 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:44.973646 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:44.975602 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO dbcounter [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] Registered counter for database nova_cell0 Aug 24 12:31:44.979533 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO dbcounter [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] Registered counter for database nova_cell1 Aug 24 12:31:44.987261 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_db.sqlalchemy.engines [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:31:44.989583 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_db.sqlalchemy.engines [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:31:44.994017 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writer thread running {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:31:44.999047 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.context [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87459494-59a1-454d-a2fa-293053432209(cell1) {{(pid=127308) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 12:31:45.004335 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:45.004818 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:45.006427 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:45.007191 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:45.007658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:45.009674 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:45.011697 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO dbcounter [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] Registered counter for database nova_cell0 Aug 24 12:31:45.015799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO dbcounter [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] Registered counter for database nova_cell1 Aug 24 12:31:45.023181 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_db.sqlalchemy.engines [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127308) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:31:45.025542 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_db.sqlalchemy.engines [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127308) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:31:45.030590 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writer thread running {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:31:45.033684 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writer thread running {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:31:45.133681 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writer thread running {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:31:45.144165 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO dbcounter [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] Registered counter for database nova_cell0 Aug 24 12:31:45.150754 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_db.sqlalchemy.engines [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:31:45.155090 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writer thread running {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:31:45.179963 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO dbcounter [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] Registered counter for database nova_cell0 Aug 24 12:31:45.189245 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_db.sqlalchemy.engines [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127308) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:31:45.193727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writer thread running {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:31:45.475847 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: WARNING keystonemiddleware.auth_token [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:31:45.483013 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: WARNING keystonemiddleware.auth_token [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:31:45.516136 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: WARNING keystonemiddleware.auth_token [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:31:45.523371 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: WARNING keystonemiddleware.auth_token [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:31:45.827992 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: WARNING keystonemiddleware.auth_token [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:31:45.834637 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: WARNING keystonemiddleware.auth_token [None req-fb3a78b2-c1f9-4de0-955d-664fe65270e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:31:45.840008 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f01a2e29c0 pid: 127307 (default app) Aug 24 12:31:45.870466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: WARNING keystonemiddleware.auth_token [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:31:45.877278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: WARNING keystonemiddleware.auth_token [None req-f1d426cc-57a6-4de7-b298-3633160d89b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:31:45.882662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f01a2e29c0 pid: 127308 (default app) Aug 24 12:32:19.959408 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=3 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:19.960194 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=3 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:19.961065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=3 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:19.962120 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=3 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:21.105449 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-84f5571f-ec47-4dc3-a964-eeeb9e1caabf tempest-VolumesGetTestJSON-1270774811 tempest-VolumesGetTestJSON-1270774811-project] Action: 'create', calling method: .version_select at 0x7f469d4245e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1208725010", "metadata": {"Type": "work"}}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:23.130804 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-84f5571f-ec47-4dc3-a964-eeeb9e1caabf tempest-VolumesGetTestJSON-1270774811 tempest-VolumesGetTestJSON-1270774811-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.180878 Aug 24 12:32:23.133027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 24 12:32:19 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3185 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 12:32:23.150205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=3 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:23.152148 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=3 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:23.152984 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=3 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:23.154642 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=3 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:23.610875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-0a0f07ad-a4a7-42fe-8212-9b38f7958698 tempest-VolumesGetTestJSON-1270774811 tempest-VolumesGetTestJSON-1270774811-project] Calling method '.version_select at 0x7f469d472310>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:24.807732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-0a0f07ad-a4a7-42fe-8212-9b38f7958698 tempest-VolumesGetTestJSON-1270774811 tempest-VolumesGetTestJSON-1270774811-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/dfc01b61-3e63-4e03-b042-be7da0926877" status: 200 len: 354 microversion: 2.1 time: 1.663817 Aug 24 12:32:24.808552 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 1/2] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:23 2022] GET /compute/v2.1/os-volumes/dfc01b61-3e63-4e03-b042-be7da0926877 => generated 354 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:24.822672 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-dff8637b-6a0d-44bf-910a-e054ca8a4292 tempest-VolumesGetTestJSON-1270774811 tempest-VolumesGetTestJSON-1270774811-project] Calling method '.version_select at 0x7f469d2f94c0>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:24.916612 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-dff8637b-6a0d-44bf-910a-e054ca8a4292 tempest-VolumesGetTestJSON-1270774811 tempest-VolumesGetTestJSON-1270774811-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/dfc01b61-3e63-4e03-b042-be7da0926877" status: 200 len: 354 microversion: 2.1 time: 0.098661 Aug 24 12:32:24.932264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:24 2022] GET /compute/v2.1/os-volumes/dfc01b61-3e63-4e03-b042-be7da0926877 => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:24.938710 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-5379f567-a926-46c5-ab8e-1b336c2befad tempest-VolumesGetTestJSON-1270774811 tempest-VolumesGetTestJSON-1270774811-project] Calling method '.version_select at 0x7f469d3364c0>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:25.100023 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-5379f567-a926-46c5-ab8e-1b336c2befad tempest-VolumesGetTestJSON-1270774811 tempest-VolumesGetTestJSON-1270774811-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/dfc01b61-3e63-4e03-b042-be7da0926877" status: 202 len: 0 microversion: 2.1 time: 0.166104 Aug 24 12:32:25.100595 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 12:32:24 2022] DELETE /compute/v2.1/os-volumes/dfc01b61-3e63-4e03-b042-be7da0926877 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:32:25.108758 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d371dbd9-d5dd-4536-aeb7-011c1d1af8f5 tempest-VolumesGetTestJSON-1270774811 tempest-VolumesGetTestJSON-1270774811-project] Calling method '.version_select at 0x7f469d2f9b80>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:25.218952 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d371dbd9-d5dd-4536-aeb7-011c1d1af8f5 tempest-VolumesGetTestJSON-1270774811 tempest-VolumesGetTestJSON-1270774811-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/dfc01b61-3e63-4e03-b042-be7da0926877" status: 200 len: 353 microversion: 2.1 time: 0.114175 Aug 24 12:32:25.219550 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 3/5] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:25 2022] GET /compute/v2.1/os-volumes/dfc01b61-3e63-4e03-b042-be7da0926877 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:26.232801 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7b7ed2cf-3904-4323-ae00-26c2dd258db9 tempest-VolumesGetTestJSON-1270774811 tempest-VolumesGetTestJSON-1270774811-project] Calling method '.version_select at 0x7f469d336b80>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:26.344276 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-7b7ed2cf-3904-4323-ae00-26c2dd258db9 tempest-VolumesGetTestJSON-1270774811 tempest-VolumesGetTestJSON-1270774811-project] HTTP exception thrown: Volume dfc01b61-3e63-4e03-b042-be7da0926877 could not be found. Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7b7ed2cf-3904-4323-ae00-26c2dd258db9 tempest-VolumesGetTestJSON-1270774811 tempest-VolumesGetTestJSON-1270774811-project] Request method failure captured: Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/os-volumes/dfc01b61-3e63-4e03-b042-be7da0926877 HTTP/1.1 Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhpT0XqxM3vjyKAxs3YDR4CN-K5zj35U2QHBMIHkTUDmV5zIBkcr9l8xGL_eAr6xcETZIsgMyZg8mq16fXdE8J3bgXENdN2ENQRz7WeaHWPO6HH6rUnu2_YpnUR_9eU7fYcI1hbvljeP3-g-3vgdzQsMholU7unasoW5nKjLK-fSgi4 Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 7b5a8391b9c34b80b3cd6f6408c0e13b Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-VolumesGetTestJSON-1270774811 Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:32:26.348405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:32:26.349940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5a8391b9c34b80b3cd6f6408c0e13b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7b5a8391b9c34b80b3cd6f6408c0e13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7b5a8391b9c34b80b3cd6f6408c0e13b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7b5a8391b9c34b80b3cd6f6408c0e13b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:32:26.349940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-VolumesGetTestJSON-1270774811 Aug 24 12:32:26.349940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 7b5a8391b9c34b80b3cd6f6408c0e13b Aug 24 12:32:26.349940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-VolumesGetTestJSON-1270774811 Aug 24 12:32:26.349940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-VolumesGetTestJSON-1270774811-project Aug 24 12:32:26.349940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:32:26.349940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:32:26.349940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 8c4727a0ef41431992676f231464f041 Aug 24 12:32:26.349940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-VolumesGetTestJSON-1270774811-project Aug 24 12:32:26.349940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: Aug 24 12:32:26.349940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Volume dfc01b61-3e63-4e03-b042-be7da0926877 could not be found. Aug 24 12:32:26.349940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': 'dfc01b61-3e63-4e03-b042-be7da0926877'} Aug 24 12:32:26.349940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dfc01b61-3e63-4e03-b042-be7da0926877 could not be found. (HTTP 404) (Request-ID: req-a1883e73-0162-4446-8370-ee08c7db9c7a) Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:26.350908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:32:26.352944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dfc01b61-3e63-4e03-b042-be7da0926877 could not be found. Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 12:32:26.354403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:32:26.356478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dfc01b61-3e63-4e03-b042-be7da0926877 could not be found. Aug 24 12:32:26.356478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:32:26.356478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:26.356478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:32:26.356478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:26.356478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:26.356478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:26.356478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:32:26.356478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:32:26.356478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dfc01b61-3e63-4e03-b042-be7da0926877 could not be found. Aug 24 12:32:26.356478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:32:26.356478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7b7ed2cf-3904-4323-ae00-26c2dd258db9 tempest-VolumesGetTestJSON-1270774811 tempest-VolumesGetTestJSON-1270774811-project] Returning 404 to user: Volume dfc01b61-3e63-4e03-b042-be7da0926877 could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:26.356478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-7b7ed2cf-3904-4323-ae00-26c2dd258db9 tempest-VolumesGetTestJSON-1270774811 tempest-VolumesGetTestJSON-1270774811-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/dfc01b61-3e63-4e03-b042-be7da0926877" status: 404 len: 109 microversion: 2.1 time: 0.120871 Aug 24 12:32:26.356478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 3/6] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:26 2022] GET /compute/v2.1/os-volumes/dfc01b61-3e63-4e03-b042-be7da0926877 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:32:37.513425 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-055b4532-fc86-4c1c-a18e-e2dd1e1047cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Action: 'create', calling method: .version_select at 0x7f469d3111f0>, body: {"keypair": {"name": "tempest-keypair-2013223063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKJA/ekXzusMl8zBbKuvlvnc1tlBD3IGcZ8b2wvqloQoAy2Cgb1+GBkI/7SRJIrzghrzkvJyBV/NP5be2ucu+3IiF/ogjlLLuHKobcG7k/rK/AFmsDFyjwMkUvGtt6P/A=="}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:37.688292 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-055b4532-fc86-4c1c-a18e-e2dd1e1047cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Getting quotas for project b38fa406b760405f8d3004db272f1e52. Resources: {'key_pairs'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:32:37.708584 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-055b4532-fc86-4c1c-a18e-e2dd1e1047cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Getting quotas for user 28dac3ee2d5c4ff5ba2d15b59e57d2a7 and project b38fa406b760405f8d3004db272f1e52. Resources: {'key_pairs'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:32:37.854096 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-8755e703-ca49-4e9e-8b25-3d0d229cdbf6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Action: 'create', calling method: .version_select at 0x7f469d2bdb80>, body: {"keypair": {"name": "tempest-keypair-1485284997", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC1+AzBF0OTUHQsVcfAhzPXH8Qm9LI7L5Pm/ACI3ljPebGLPOi7ahJcNLJ29VXHTR/0chKl7wX03sjaxz+pvllkRPFzIh5ap0XelZqHVrxjHSa8qRBEJh/DOvB/FYWNGQ=="}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:37.868407 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-055b4532-fc86-4c1c-a18e-e2dd1e1047cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.648601 Aug 24 12:32:37.883354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 4/7] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 24 12:32:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 667 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 12:32:38.036860 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-8755e703-ca49-4e9e-8b25-3d0d229cdbf6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Getting quotas for project 36bd9970f0694314b966d86f13b83d4b. Resources: {'key_pairs'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:32:38.055340 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-8755e703-ca49-4e9e-8b25-3d0d229cdbf6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Getting quotas for user ed0d97f3f08f46af851492aee6a8d0ef and project 36bd9970f0694314b966d86f13b83d4b. Resources: {'key_pairs'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:32:38.253518 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-8755e703-ca49-4e9e-8b25-3d0d229cdbf6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.641606 Aug 24 12:32:38.254179 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 4/8] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 12:32:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:32:38.457747 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-515435846", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "networks": [{"uuid": "bfe9fea2-0920-4670-90ce-7e5333476757"}]}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:38.749176 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.network.neutron [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] validate_networks() for [('bfe9fea2-0920-4670-90ce-7e5333476757', None, None, None, None, None)] {{(pid=127307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:32:41.712331 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Flavor limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:32:41.713110 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Image limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:32:41.718443 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Flavor pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:32:41.718912 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Image pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:32:41.719347 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:32:41.826650 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:41.829816 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:41.830842 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:41.834604 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:41.837360 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:41.846315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:41.951657 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Getting quotas for project 2fd2c804427749c68ff038d019a1628b. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:32:41.959013 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Getting quotas for user 539573490e0d4e128caf93c51567ed79 and project 2fd2c804427749c68ff038d019a1628b. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:32:41.997951 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Going to run 1 instances... {{(pid=127307) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:32:42.004651 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:32:42.227216 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f3342955-1788-4201-8234-5e2e3f10be7f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.110905 Aug 24 12:32:42.228297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 5/9] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:32:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 4113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 12:32:42.246370 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-647d164a-f988-4bc7-951a-c15033ab19e9 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:42.248196 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-647d164a-f988-4bc7-951a-c15033ab19e9 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:42.703409 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-647d164a-f988-4bc7-951a-c15033ab19e9 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:42.740324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-647d164a-f988-4bc7-951a-c15033ab19e9 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1214 microversion: 2.1 time: 0.500585 Aug 24 12:32:42.743367 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 5/10] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:42 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1214 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:43.767008 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-13fcf577-947a-466c-ab30-3cc6954407eb tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:43.767738 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-13fcf577-947a-466c-ab30-3cc6954407eb tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:44.150391 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-13fcf577-947a-466c-ab30-3cc6954407eb tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:44.185604 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-13fcf577-947a-466c-ab30-3cc6954407eb tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1214 microversion: 2.1 time: 0.423698 Aug 24 12:32:44.189982 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 6/11] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:43 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1214 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:45.216043 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2c38648d-013f-43c7-9aff-944f8062687d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:45.216718 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2c38648d-013f-43c7-9aff-944f8062687d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:45.227736 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c38648d-013f-43c7-9aff-944f8062687d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:45.228225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c38648d-013f-43c7-9aff-944f8062687d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:45.245329 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c38648d-013f-43c7-9aff-944f8062687d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:45.247776 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c38648d-013f-43c7-9aff-944f8062687d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:45.247776 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c38648d-013f-43c7-9aff-944f8062687d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:45.247776 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c38648d-013f-43c7-9aff-944f8062687d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:45.751221 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-1b16182a-8b30-4b4c-a2fe-f4bd34061bcd tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Action: 'create', calling method: .version_select at 0x7f469c9d5af0>, body: {"keypair": {"name": "tempest-keypair-87239204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwtYmo34YJQmQFhVRM891gmJy1XXyY7PZNoXoP/OzA5UdrftwNBvvcgsqISxV2qabKJh8mn00NsDW+NKE9h2Zkmdzv3qMpVlIJLenhBX3jp1ZtZmp93ZUWBr0TnNXSpQA=="}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:45.800351 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-1b16182a-8b30-4b4c-a2fe-f4bd34061bcd tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for project f3a2fec602684ab1a454b8da589b4787. Resources: {'key_pairs'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:32:45.805171 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-1b16182a-8b30-4b4c-a2fe-f4bd34061bcd tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for user 9aa753d1e2c4430498d5b28f0304952f and project f3a2fec602684ab1a454b8da589b4787. Resources: {'key_pairs'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:32:45.862014 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-1b16182a-8b30-4b4c-a2fe-f4bd34061bcd tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.430532 Aug 24 12:32:45.863262 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 7/12] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 12:32:45 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:45.899088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2c38648d-013f-43c7-9aff-944f8062687d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:45.922854 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2c38648d-013f-43c7-9aff-944f8062687d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1210 microversion: 2.1 time: 0.707816 Aug 24 12:32:45.934503 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 6/13] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:45 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1210 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:46.519414 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1215248089", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f380c7c-ae49-41e6-a0f6-8e8b66ed6334"}], "security_groups": [{"name": "tempest-securitygroup--1601642570"}], "key_name": "tempest-keypair-2013223063", "user_data": "}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:46.555858 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1674598459", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:46.749925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.network.neutron [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] validate_networks() for [('2dc0cfb6-341d-429c-9c42-4b53f3cb8f09', None, None, None, None, None)] {{(pid=127307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:32:47.259854 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.network.neutron [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] validate_networks() for [('0f380c7c-ae49-41e6-a0f6-8e8b66ed6334', None, None, None, None, None)] {{(pid=127308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:32:49.794720 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Flavor limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:32:49.796290 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Image limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:32:49.797237 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Flavor pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:32:49.797579 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Image pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:32:49.798105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:32:49.829477 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:49.832845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:49.833478 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:49.836417 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:49.840310 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:49.842945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:49.921507 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Getting quotas for project 9afa0216c9e140bb82f56f14ccfb7bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:32:49.959157 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Getting quotas for user 9138ac21bbdb4577a7f43b5ab471d572 and project 9afa0216c9e140bb82f56f14ccfb7bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:32:50.009767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Going to run 1 instances... {{(pid=127307) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:32:50.015095 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:32:50.187044 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ec6da807-f5bf-4261-9677-e447506735ad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.308927 Aug 24 12:32:50.190883 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 8/14] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:32:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 4327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:32:50.222449 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-56dd25e9-2030-4b34-bb29-e456cd92965d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:50.234621 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-56dd25e9-2030-4b34-bb29-e456cd92965d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:50.271268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-56dd25e9-2030-4b34-bb29-e456cd92965d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:50.272113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-56dd25e9-2030-4b34-bb29-e456cd92965d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:50.272730 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-56dd25e9-2030-4b34-bb29-e456cd92965d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:50.274647 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-56dd25e9-2030-4b34-bb29-e456cd92965d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:50.281013 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-56dd25e9-2030-4b34-bb29-e456cd92965d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:50.282167 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-56dd25e9-2030-4b34-bb29-e456cd92965d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:51.576740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Flavor limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:32:51.578448 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Image limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:32:51.579099 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Flavor pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:32:51.579697 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Image pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:32:51.584312 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:32:51.620032 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:51.624275 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:51.624737 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:51.625549 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:51.626012 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:51.633008 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:51.746856 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Getting quotas for project b38fa406b760405f8d3004db272f1e52. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:32:51.763750 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Getting quotas for user 28dac3ee2d5c4ff5ba2d15b59e57d2a7 and project b38fa406b760405f8d3004db272f1e52. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:32:51.781393 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Going to run 1 instances... {{(pid=127308) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:32:51.794489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:32:51.811717 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-56dd25e9-2030-4b34-bb29-e456cd92965d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:51.834735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-56dd25e9-2030-4b34-bb29-e456cd92965d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 1.636793 Aug 24 12:32:51.835494 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 9/15] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:50 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:51.850485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-404095279", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9c96c4a-d3b6-4e77-bd97-a11060309e95"}], "security_groups": [{"name": "tempest-securitygroup--177997"}], "key_name": "tempest-keypair-1485284997", "user_data": "}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:51.948635 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-be2bad9d-c191-44f2-99ff-92a6f6b766bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.436750 Aug 24 12:32:51.956612 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 7/16] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 12:32:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 5441 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 12:32:51.960283 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-6bc4c87e-34b0-4dc1-83a9-f7b0a65e11db tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:51.960918 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-6bc4c87e-34b0-4dc1-83a9-f7b0a65e11db tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:52.485806 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6bc4c87e-34b0-4dc1-83a9-f7b0a65e11db tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:52.508141 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-6bc4c87e-34b0-4dc1-83a9-f7b0a65e11db tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1222 microversion: 2.1 time: 0.554353 Aug 24 12:32:52.532718 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 8/17] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:51 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1222 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:52.550726 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-4303591", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6afd549-e037-4fe8-8751-48a00c7127d1"}], "security_groups": [{"name": "tempest-securitygroup--1459650450"}], "key_name": "tempest-keypair-87239204", "user_data": "}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:52.994648 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.network.neutron [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] validate_networks() for [('c9c96c4a-d3b6-4e77-bd97-a11060309e95', None, None, None, None, None)] {{(pid=127307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:32:53.071364 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.network.neutron [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] validate_networks() for [('a6afd549-e037-4fe8-8751-48a00c7127d1', None, None, None, None, None)] {{(pid=127308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:32:55.715240 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Flavor limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:32:55.715949 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Image limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:32:55.716348 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Flavor pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:32:55.716918 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Image pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:32:55.717624 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:32:55.762166 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:55.763260 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:55.764379 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:55.765184 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:55.765654 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:55.766090 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:55.849198 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for project f3a2fec602684ab1a454b8da589b4787. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:32:55.857054 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for user 9aa753d1e2c4430498d5b28f0304952f and project f3a2fec602684ab1a454b8da589b4787. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:32:55.908965 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Going to run 1 instances... {{(pid=127308) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:32:55.911854 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:32:56.002026 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d84940ba-4aad-413d-b8f3-5b36d0ce96dc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.467571 Aug 24 12:32:56.012619 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 9/18] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:32:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 3479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:32:56.026261 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-eeff0732-1018-4ae8-9efd-8f5cc969a6c6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:56.027819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-eeff0732-1018-4ae8-9efd-8f5cc969a6c6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:56.043125 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-eeff0732-1018-4ae8-9efd-8f5cc969a6c6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:56.043937 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-eeff0732-1018-4ae8-9efd-8f5cc969a6c6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:56.044545 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-eeff0732-1018-4ae8-9efd-8f5cc969a6c6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:56.045746 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-eeff0732-1018-4ae8-9efd-8f5cc969a6c6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:56.046359 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-eeff0732-1018-4ae8-9efd-8f5cc969a6c6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:56.047588 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-eeff0732-1018-4ae8-9efd-8f5cc969a6c6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:56.262293 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Flavor limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:32:56.263230 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Image limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:32:56.264753 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Flavor pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:32:56.271199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Image pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:32:56.272246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:32:56.302126 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:56.303057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:56.304542 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:56.305799 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:56.309462 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:56.311517 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:56.387507 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Getting quotas for project 36bd9970f0694314b966d86f13b83d4b. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:32:56.398049 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Getting quotas for user ed0d97f3f08f46af851492aee6a8d0ef and project 36bd9970f0694314b966d86f13b83d4b. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:32:56.413290 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-eeff0732-1018-4ae8-9efd-8f5cc969a6c6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:56.427828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-eeff0732-1018-4ae8-9efd-8f5cc969a6c6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:56.434052 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-eeff0732-1018-4ae8-9efd-8f5cc969a6c6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:56.437746 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-eeff0732-1018-4ae8-9efd-8f5cc969a6c6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1340 microversion: 2.20 time: 0.421955 Aug 24 12:32:56.439499 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 10/19] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:32:56 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1340 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:32:56.455775 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Going to run 1 instances... {{(pid=127307) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:32:56.455775 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:32:56.463921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-470a9b53-4afd-42fe-b60b-07d647d7fe54 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:56.465390 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-470a9b53-4afd-42fe-b60b-07d647d7fe54 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:56.474833 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-470a9b53-4afd-42fe-b60b-07d647d7fe54 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:56.475927 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-470a9b53-4afd-42fe-b60b-07d647d7fe54 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:56.476813 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-470a9b53-4afd-42fe-b60b-07d647d7fe54 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:56.478217 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-470a9b53-4afd-42fe-b60b-07d647d7fe54 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:56.479006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-470a9b53-4afd-42fe-b60b-07d647d7fe54 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:56.479814 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-470a9b53-4afd-42fe-b60b-07d647d7fe54 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:56.635605 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-7f723839-743f-448f-bb02-102333a6c59e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 4.797942 Aug 24 12:32:56.639851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 10/20] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:32:51 2022] POST /compute/v2.1/servers => generated 398 bytes in 4803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:32:56.651668 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1401558209", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:56.829010 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.network.neutron [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] validate_networks() for [('2dc0cfb6-341d-429c-9c42-4b53f3cb8f09', None, None, None, None, None)] {{(pid=127307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:32:58.059570 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-470a9b53-4afd-42fe-b60b-07d647d7fe54 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:58.073486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-470a9b53-4afd-42fe-b60b-07d647d7fe54 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 1.615300 Aug 24 12:32:58.074084 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 11/21] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:56 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:58.092761 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4c75fa07-e6e2-4926-86de-fd7a8b359c6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:58.093385 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4c75fa07-e6e2-4926-86de-fd7a8b359c6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:58.118919 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4c75fa07-e6e2-4926-86de-fd7a8b359c6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:58.125946 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4c75fa07-e6e2-4926-86de-fd7a8b359c6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:58.126415 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4c75fa07-e6e2-4926-86de-fd7a8b359c6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:58.127161 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4c75fa07-e6e2-4926-86de-fd7a8b359c6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:58.127704 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4c75fa07-e6e2-4926-86de-fd7a8b359c6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:58.137811 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4c75fa07-e6e2-4926-86de-fd7a8b359c6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:58.393585 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4c75fa07-e6e2-4926-86de-fd7a8b359c6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:58.412828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4c75fa07-e6e2-4926-86de-fd7a8b359c6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1289 microversion: 2.1 time: 0.332537 Aug 24 12:32:58.415711 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 12/22] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:58 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1289 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:58.440570 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d687c323-b07f-4305-9a28-0603c64685ab tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:58.441460 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d687c323-b07f-4305-9a28-0603c64685ab tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:58.460192 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d687c323-b07f-4305-9a28-0603c64685ab tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:58.469151 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d687c323-b07f-4305-9a28-0603c64685ab tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:58.470495 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d687c323-b07f-4305-9a28-0603c64685ab tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:58.472531 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d687c323-b07f-4305-9a28-0603c64685ab tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:58.479592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d687c323-b07f-4305-9a28-0603c64685ab tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:58.480325 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d687c323-b07f-4305-9a28-0603c64685ab tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:58.741005 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d687c323-b07f-4305-9a28-0603c64685ab tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:58.761053 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d687c323-b07f-4305-9a28-0603c64685ab tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1241 microversion: 2.1 time: 0.342107 Aug 24 12:32:58.768225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 13/23] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:58 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1241 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:58.782799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c18bb5a9-1bb6-40cd-bbd2-6fb18e41343e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:58.785524 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c18bb5a9-1bb6-40cd-bbd2-6fb18e41343e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:58.826735 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c18bb5a9-1bb6-40cd-bbd2-6fb18e41343e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:58.830101 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c18bb5a9-1bb6-40cd-bbd2-6fb18e41343e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:58.831953 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c18bb5a9-1bb6-40cd-bbd2-6fb18e41343e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:58.835532 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c18bb5a9-1bb6-40cd-bbd2-6fb18e41343e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:58.838549 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c18bb5a9-1bb6-40cd-bbd2-6fb18e41343e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:58.839320 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c18bb5a9-1bb6-40cd-bbd2-6fb18e41343e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:59.242552 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Flavor limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:32:59.243198 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Image limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:32:59.243847 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Flavor pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:32:59.244258 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Image pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:32:59.244730 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:32:59.307987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:59.312251 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:59.314454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:59.317245 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:59.317745 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:59.318198 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:59.446082 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Getting quotas for project 9afa0216c9e140bb82f56f14ccfb7bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:32:59.474565 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Getting quotas for user 9138ac21bbdb4577a7f43b5ab471d572 and project 9afa0216c9e140bb82f56f14ccfb7bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:32:59.518023 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c18bb5a9-1bb6-40cd-bbd2-6fb18e41343e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:59.525215 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Going to run 1 instances... {{(pid=127307) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:32:59.532021 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:32:59.537224 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c18bb5a9-1bb6-40cd-bbd2-6fb18e41343e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:59.539919 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c18bb5a9-1bb6-40cd-bbd2-6fb18e41343e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:59.542917 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c18bb5a9-1bb6-40cd-bbd2-6fb18e41343e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1340 microversion: 2.20 time: 0.772089 Aug 24 12:32:59.544235 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 14/24] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:32:58 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1340 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:32:59.826482 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d87f9106-f3bf-4d5a-a780-5a2fcd1b1d26 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.182784 Aug 24 12:32:59.844521 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 11/25] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:32:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 3204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:32:59.855293 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5267a089-3811-4a5d-ae95-9ba8b9b26e4a tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:59.857304 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5267a089-3811-4a5d-ae95-9ba8b9b26e4a tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:59.912746 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5267a089-3811-4a5d-ae95-9ba8b9b26e4a tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:59.935397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5267a089-3811-4a5d-ae95-9ba8b9b26e4a tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:59.936410 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5267a089-3811-4a5d-ae95-9ba8b9b26e4a tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:59.941585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5267a089-3811-4a5d-ae95-9ba8b9b26e4a tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:59.943809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5267a089-3811-4a5d-ae95-9ba8b9b26e4a tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:59.944444 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5267a089-3811-4a5d-ae95-9ba8b9b26e4a tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:00.080163 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-f3ecac6e-9e59-468e-971c-6bc1a9fef919 req-1ac113a3-9769-4672-b3ad-8fe3ad3fcc0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46eaa161-78d7-4c8a-9fe7-f1accd97238a", "tag": "6e8bd6e8-d063-4381-b0f9-4b7b031b124e"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:00.117807 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-f3ecac6e-9e59-468e-971c-6bc1a9fef919 req-1ac113a3-9769-4672-b3ad-8fe3ad3fcc0a service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:00.119396 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-f3ecac6e-9e59-468e-971c-6bc1a9fef919 req-1ac113a3-9769-4672-b3ad-8fe3ad3fcc0a service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:00.121014 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-f3ecac6e-9e59-468e-971c-6bc1a9fef919 req-1ac113a3-9769-4672-b3ad-8fe3ad3fcc0a service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:00.179826 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-f3ecac6e-9e59-468e-971c-6bc1a9fef919 req-1ac113a3-9769-4672-b3ad-8fe3ad3fcc0a service nova] Creating event network-changed:6e8bd6e8-d063-4381-b0f9-4b7b031b124e for instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a on hv-cinder-84890 Aug 24 12:33:00.186193 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-f3ecac6e-9e59-468e-971c-6bc1a9fef919 req-1ac113a3-9769-4672-b3ad-8fe3ad3fcc0a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127308) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 12:33:00.187139 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-f3ecac6e-9e59-468e-971c-6bc1a9fef919 req-1ac113a3-9769-4672-b3ad-8fe3ad3fcc0a service nova] Acquired lock "compute-rpcapi-router" {{(pid=127308) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 12:33:00.190392 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-94f91d6d-200f-4b10-8e2b-8d5c3a85c795 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:00.191579 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-94f91d6d-200f-4b10-8e2b-8d5c3a85c795 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:00.193346 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-94f91d6d-200f-4b10-8e2b-8d5c3a85c795 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:00.198733 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-94f91d6d-200f-4b10-8e2b-8d5c3a85c795 None None] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:00.216416 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-94f91d6d-200f-4b10-8e2b-8d5c3a85c795 None None] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:00.221646 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-94f91d6d-200f-4b10-8e2b-8d5c3a85c795 None None] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:00.261011 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.compute.rpcapi [None req-94f91d6d-200f-4b10-8e2b-8d5c3a85c795 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 12:33:00.262141 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-94f91d6d-200f-4b10-8e2b-8d5c3a85c795 None None] Releasing lock "compute-rpcapi-router" {{(pid=127308) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 12:33:00.309950 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-94f91d6d-200f-4b10-8e2b-8d5c3a85c795 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.762271 Aug 24 12:33:00.311471 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 15/26] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:00.318369 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-fa9a5680-406d-477a-827f-2e4480791d55 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:00.322307 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-fa9a5680-406d-477a-827f-2e4480791d55 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:00.341140 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fa9a5680-406d-477a-827f-2e4480791d55 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:00.343317 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fa9a5680-406d-477a-827f-2e4480791d55 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:00.344998 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fa9a5680-406d-477a-827f-2e4480791d55 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:00.347683 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fa9a5680-406d-477a-827f-2e4480791d55 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:00.355016 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fa9a5680-406d-477a-827f-2e4480791d55 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:00.356731 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fa9a5680-406d-477a-827f-2e4480791d55 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:00.509374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5267a089-3811-4a5d-ae95-9ba8b9b26e4a tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:00.525090 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5267a089-3811-4a5d-ae95-9ba8b9b26e4a tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.679438 Aug 24 12:33:00.551267 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 12/27] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:59 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:00.577575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-36c6d3b9-e538-4437-86ab-6ebb810b4657 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:00.578854 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-36c6d3b9-e538-4437-86ab-6ebb810b4657 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:00.604447 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:00.612629 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-36c6d3b9-e538-4437-86ab-6ebb810b4657 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:00.616816 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-36c6d3b9-e538-4437-86ab-6ebb810b4657 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:00.618617 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-36c6d3b9-e538-4437-86ab-6ebb810b4657 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:00.623250 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-36c6d3b9-e538-4437-86ab-6ebb810b4657 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:00.628264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-36c6d3b9-e538-4437-86ab-6ebb810b4657 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:00.630903 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-36c6d3b9-e538-4437-86ab-6ebb810b4657 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:00.668838 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-fa9a5680-406d-477a-827f-2e4480791d55 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:00.685464 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-fa9a5680-406d-477a-827f-2e4480791d55 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1295 microversion: 2.1 time: 0.372650 Aug 24 12:33:00.687733 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 16/28] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:00 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1295 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:00.713364 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-94fd95dc-90e7-4509-9ca3-9c177a290ad3 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:00.715572 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-94fd95dc-90e7-4509-9ca3-9c177a290ad3 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:01.055606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-36c6d3b9-e538-4437-86ab-6ebb810b4657 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:01.074722 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-36c6d3b9-e538-4437-86ab-6ebb810b4657 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1295 microversion: 2.1 time: 0.517850 Aug 24 12:33:01.076706 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 13/29] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:00 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1295 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:01.096438 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ae0f7658-1baf-4430-84fa-8844ceef7ae9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:01.105911 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ae0f7658-1baf-4430-84fa-8844ceef7ae9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:01.130816 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ae0f7658-1baf-4430-84fa-8844ceef7ae9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:01.131310 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ae0f7658-1baf-4430-84fa-8844ceef7ae9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:01.131879 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ae0f7658-1baf-4430-84fa-8844ceef7ae9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:01.132451 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ae0f7658-1baf-4430-84fa-8844ceef7ae9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:01.132910 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ae0f7658-1baf-4430-84fa-8844ceef7ae9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:01.133335 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ae0f7658-1baf-4430-84fa-8844ceef7ae9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:01.788726 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-94fd95dc-90e7-4509-9ca3-9c177a290ad3 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:01.812465 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-94fd95dc-90e7-4509-9ca3-9c177a290ad3 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1222 microversion: 2.1 time: 1.118944 Aug 24 12:33:01.813395 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 17/30] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:00 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1222 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:01.839986 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-339aa5ba-2564-4849-862b-2de04e23751b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:01.846088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-339aa5ba-2564-4849-862b-2de04e23751b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:01.911526 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-339aa5ba-2564-4849-862b-2de04e23751b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:01.914072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-339aa5ba-2564-4849-862b-2de04e23751b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:01.915647 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-339aa5ba-2564-4849-862b-2de04e23751b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:01.920680 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-339aa5ba-2564-4849-862b-2de04e23751b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:01.921683 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-339aa5ba-2564-4849-862b-2de04e23751b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:01.928023 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-339aa5ba-2564-4849-862b-2de04e23751b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:02.377881 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ae0f7658-1baf-4430-84fa-8844ceef7ae9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:02.395523 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ae0f7658-1baf-4430-84fa-8844ceef7ae9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:02.397097 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ae0f7658-1baf-4430-84fa-8844ceef7ae9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:02.398234 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ae0f7658-1baf-4430-84fa-8844ceef7ae9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 1.319512 Aug 24 12:33:02.398817 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 14/31] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:01 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:33:02.432892 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-78dc046e-2cc0-4b5e-a829-544bb76e50bc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:02.433521 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-78dc046e-2cc0-4b5e-a829-544bb76e50bc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:02.472808 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-78dc046e-2cc0-4b5e-a829-544bb76e50bc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:02.473330 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-78dc046e-2cc0-4b5e-a829-544bb76e50bc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:02.473786 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-78dc046e-2cc0-4b5e-a829-544bb76e50bc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:02.474529 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-78dc046e-2cc0-4b5e-a829-544bb76e50bc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:02.474989 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-78dc046e-2cc0-4b5e-a829-544bb76e50bc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:02.475420 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-78dc046e-2cc0-4b5e-a829-544bb76e50bc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:02.630345 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-339aa5ba-2564-4849-862b-2de04e23751b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:02.644947 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-339aa5ba-2564-4849-862b-2de04e23751b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.827128 Aug 24 12:33:02.647935 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 18/32] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:01 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:02.658680 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b134fb01-085c-4b3f-9ec4-8cc61b20569e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:02.665919 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b134fb01-085c-4b3f-9ec4-8cc61b20569e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:02.672571 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b134fb01-085c-4b3f-9ec4-8cc61b20569e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:02.676343 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b134fb01-085c-4b3f-9ec4-8cc61b20569e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:02.678266 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b134fb01-085c-4b3f-9ec4-8cc61b20569e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:02.679102 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b134fb01-085c-4b3f-9ec4-8cc61b20569e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:02.681083 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b134fb01-085c-4b3f-9ec4-8cc61b20569e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:02.681640 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b134fb01-085c-4b3f-9ec4-8cc61b20569e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:02.729228 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-78dc046e-2cc0-4b5e-a829-544bb76e50bc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:02.744245 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-78dc046e-2cc0-4b5e-a829-544bb76e50bc tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1295 microversion: 2.1 time: 0.318900 Aug 24 12:33:02.760832 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 15/33] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:02 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1295 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:02.835590 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-56743afd-29bf-4af9-a777-d408a3c004bd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:02.836266 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-56743afd-29bf-4af9-a777-d408a3c004bd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:02.845569 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-56743afd-29bf-4af9-a777-d408a3c004bd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:02.847007 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-56743afd-29bf-4af9-a777-d408a3c004bd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:02.847459 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-56743afd-29bf-4af9-a777-d408a3c004bd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:02.847931 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b134fb01-085c-4b3f-9ec4-8cc61b20569e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:02.848439 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-56743afd-29bf-4af9-a777-d408a3c004bd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:02.848653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-56743afd-29bf-4af9-a777-d408a3c004bd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:02.849086 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-56743afd-29bf-4af9-a777-d408a3c004bd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:02.866046 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b134fb01-085c-4b3f-9ec4-8cc61b20569e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1295 microversion: 2.1 time: 0.216804 Aug 24 12:33:02.868481 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 19/34] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:02 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1295 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:02.971940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-56743afd-29bf-4af9-a777-d408a3c004bd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:02.983067 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-56743afd-29bf-4af9-a777-d408a3c004bd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1274 microversion: 2.1 time: 0.151958 Aug 24 12:33:02.996095 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 16/35] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:02 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1274 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:03.428774 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1fef2d48-3531-41ef-bcb1-ac1bf748eace tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:03.429576 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1fef2d48-3531-41ef-bcb1-ac1bf748eace tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:03.437480 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1fef2d48-3531-41ef-bcb1-ac1bf748eace tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:03.438521 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1fef2d48-3531-41ef-bcb1-ac1bf748eace tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:03.439108 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1fef2d48-3531-41ef-bcb1-ac1bf748eace tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:03.440039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1fef2d48-3531-41ef-bcb1-ac1bf748eace tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:03.440896 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1fef2d48-3531-41ef-bcb1-ac1bf748eace tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:03.441462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1fef2d48-3531-41ef-bcb1-ac1bf748eace tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:03.611229 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1fef2d48-3531-41ef-bcb1-ac1bf748eace tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:03.623818 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1fef2d48-3531-41ef-bcb1-ac1bf748eace tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:03.627079 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1fef2d48-3531-41ef-bcb1-ac1bf748eace tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:03.628530 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1fef2d48-3531-41ef-bcb1-ac1bf748eace tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.204960 Aug 24 12:33:03.630271 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 20/36] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:03 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:33:03.671151 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-1bd77205-fcb3-440c-8335-e5ce398d1669 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:03.672501 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-1bd77205-fcb3-440c-8335-e5ce398d1669 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:03.681835 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1bd77205-fcb3-440c-8335-e5ce398d1669 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:03.682409 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1bd77205-fcb3-440c-8335-e5ce398d1669 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:03.683293 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1bd77205-fcb3-440c-8335-e5ce398d1669 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:03.684368 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1bd77205-fcb3-440c-8335-e5ce398d1669 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:03.684902 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1bd77205-fcb3-440c-8335-e5ce398d1669 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:03.685809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1bd77205-fcb3-440c-8335-e5ce398d1669 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:03.764824 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b6262ab6-b333-4e07-989c-5b1767643a73 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:03.765755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b6262ab6-b333-4e07-989c-5b1767643a73 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:03.775996 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b6262ab6-b333-4e07-989c-5b1767643a73 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:03.777251 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b6262ab6-b333-4e07-989c-5b1767643a73 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:03.778152 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b6262ab6-b333-4e07-989c-5b1767643a73 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:03.780229 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b6262ab6-b333-4e07-989c-5b1767643a73 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:03.781508 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b6262ab6-b333-4e07-989c-5b1767643a73 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:03.782239 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b6262ab6-b333-4e07-989c-5b1767643a73 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:04.136966 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-1bd77205-fcb3-440c-8335-e5ce398d1669 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:04.152485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-1bd77205-fcb3-440c-8335-e5ce398d1669 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.489190 Aug 24 12:33:04.153071 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 17/37] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:03 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:04.158241 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-76144667-a1e2-4bbe-b045-7c710df1fb60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:04.158862 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-76144667-a1e2-4bbe-b045-7c710df1fb60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:04.187037 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76144667-a1e2-4bbe-b045-7c710df1fb60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:04.189255 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76144667-a1e2-4bbe-b045-7c710df1fb60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:04.189725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76144667-a1e2-4bbe-b045-7c710df1fb60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:04.190795 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76144667-a1e2-4bbe-b045-7c710df1fb60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:04.191321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76144667-a1e2-4bbe-b045-7c710df1fb60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:04.191802 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76144667-a1e2-4bbe-b045-7c710df1fb60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:04.278658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b6262ab6-b333-4e07-989c-5b1767643a73 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:04.290909 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b6262ab6-b333-4e07-989c-5b1767643a73 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.530402 Aug 24 12:33:04.291699 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 21/38] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:03 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:04.301965 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4e46ccac-3a61-4f4a-9632-b1d8accb9fbb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:04.302816 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4e46ccac-3a61-4f4a-9632-b1d8accb9fbb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:04.314173 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e46ccac-3a61-4f4a-9632-b1d8accb9fbb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:04.314836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e46ccac-3a61-4f4a-9632-b1d8accb9fbb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:04.315422 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e46ccac-3a61-4f4a-9632-b1d8accb9fbb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:04.316332 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e46ccac-3a61-4f4a-9632-b1d8accb9fbb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:04.316949 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e46ccac-3a61-4f4a-9632-b1d8accb9fbb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:04.317690 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e46ccac-3a61-4f4a-9632-b1d8accb9fbb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:04.407003 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-76144667-a1e2-4bbe-b045-7c710df1fb60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:04.426838 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4e46ccac-3a61-4f4a-9632-b1d8accb9fbb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:04.434230 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-76144667-a1e2-4bbe-b045-7c710df1fb60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.278731 Aug 24 12:33:04.437022 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 18/39] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:04 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:04.440076 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4e46ccac-3a61-4f4a-9632-b1d8accb9fbb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1274 microversion: 2.1 time: 0.142527 Aug 24 12:33:04.452553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 22/40] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:04 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:04.506517 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-503d27a8-c603-4f00-9964-9e3a42b40529 req-620c0356-aad3-41b6-98cf-d1306ccca9fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3027685-43d2-43dc-92d2-ac44b036c061", "tag": "c9418bfd-867a-4096-a9ce-235b0174885a"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:04.522973 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-503d27a8-c603-4f00-9964-9e3a42b40529 req-620c0356-aad3-41b6-98cf-d1306ccca9fd service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:04.523560 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-503d27a8-c603-4f00-9964-9e3a42b40529 req-620c0356-aad3-41b6-98cf-d1306ccca9fd service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:04.524308 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-503d27a8-c603-4f00-9964-9e3a42b40529 req-620c0356-aad3-41b6-98cf-d1306ccca9fd service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:04.548614 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-503d27a8-c603-4f00-9964-9e3a42b40529 req-620c0356-aad3-41b6-98cf-d1306ccca9fd service nova] Creating event network-changed:c9418bfd-867a-4096-a9ce-235b0174885a for instance a3027685-43d2-43dc-92d2-ac44b036c061 on hv-cinder-84890 Aug 24 12:33:04.549336 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-503d27a8-c603-4f00-9964-9e3a42b40529 req-620c0356-aad3-41b6-98cf-d1306ccca9fd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127307) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 12:33:04.549725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-503d27a8-c603-4f00-9964-9e3a42b40529 req-620c0356-aad3-41b6-98cf-d1306ccca9fd service nova] Acquired lock "compute-rpcapi-router" {{(pid=127307) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 12:33:04.550749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-88ea76da-5a70-4e78-99e5-49b295bc6ee5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:04.552301 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-88ea76da-5a70-4e78-99e5-49b295bc6ee5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:04.552882 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-88ea76da-5a70-4e78-99e5-49b295bc6ee5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:04.553741 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-88ea76da-5a70-4e78-99e5-49b295bc6ee5 None None] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:04.554262 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-88ea76da-5a70-4e78-99e5-49b295bc6ee5 None None] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:04.554774 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-88ea76da-5a70-4e78-99e5-49b295bc6ee5 None None] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:04.564267 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.compute.rpcapi [None req-88ea76da-5a70-4e78-99e5-49b295bc6ee5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 12:33:04.565226 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-88ea76da-5a70-4e78-99e5-49b295bc6ee5 None None] Releasing lock "compute-rpcapi-router" {{(pid=127307) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 12:33:04.580909 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-88ea76da-5a70-4e78-99e5-49b295bc6ee5 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142221 Aug 24 12:33:04.582022 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 19/41] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:04.652982 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a868eb3a-cc25-4f37-8e02-cf3d0b7e63a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:04.653683 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-a868eb3a-cc25-4f37-8e02-cf3d0b7e63a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:04.660513 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a868eb3a-cc25-4f37-8e02-cf3d0b7e63a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:04.661175 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a868eb3a-cc25-4f37-8e02-cf3d0b7e63a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:04.661621 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a868eb3a-cc25-4f37-8e02-cf3d0b7e63a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:04.662474 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a868eb3a-cc25-4f37-8e02-cf3d0b7e63a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:04.663191 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a868eb3a-cc25-4f37-8e02-cf3d0b7e63a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:04.663661 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a868eb3a-cc25-4f37-8e02-cf3d0b7e63a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:04.803830 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-a868eb3a-cc25-4f37-8e02-cf3d0b7e63a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:04.812514 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-a868eb3a-cc25-4f37-8e02-cf3d0b7e63a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:04.814065 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-a868eb3a-cc25-4f37-8e02-cf3d0b7e63a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:04.815171 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a868eb3a-cc25-4f37-8e02-cf3d0b7e63a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.166649 Aug 24 12:33:04.815757 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 23/42] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:04 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:33:05.182932 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-7864cc02-7fa6-449d-9e83-099d66c23d04 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:05.184047 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-7864cc02-7fa6-449d-9e83-099d66c23d04 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:05.198002 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7864cc02-7fa6-449d-9e83-099d66c23d04 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:05.198505 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7864cc02-7fa6-449d-9e83-099d66c23d04 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:05.198949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7864cc02-7fa6-449d-9e83-099d66c23d04 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:05.199678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7864cc02-7fa6-449d-9e83-099d66c23d04 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:05.200285 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7864cc02-7fa6-449d-9e83-099d66c23d04 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:05.201464 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7864cc02-7fa6-449d-9e83-099d66c23d04 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:05.314328 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-741b3123-f123-4f47-b260-e0df2f3b078c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:05.315717 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-741b3123-f123-4f47-b260-e0df2f3b078c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:05.326541 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-741b3123-f123-4f47-b260-e0df2f3b078c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:05.328410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-741b3123-f123-4f47-b260-e0df2f3b078c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:05.329321 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-741b3123-f123-4f47-b260-e0df2f3b078c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:05.330465 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-741b3123-f123-4f47-b260-e0df2f3b078c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:05.340210 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-741b3123-f123-4f47-b260-e0df2f3b078c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:05.340951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-741b3123-f123-4f47-b260-e0df2f3b078c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:05.533295 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7864cc02-7fa6-449d-9e83-099d66c23d04 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:05.544323 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-7864cc02-7fa6-449d-9e83-099d66c23d04 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.367111 Aug 24 12:33:05.562634 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 20/43] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:05 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:05.574700 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-20306fa8-8188-49a4-9aa2-c37b60cb085c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:05.577929 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-20306fa8-8188-49a4-9aa2-c37b60cb085c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:05.591152 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-20306fa8-8188-49a4-9aa2-c37b60cb085c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:05.593389 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-20306fa8-8188-49a4-9aa2-c37b60cb085c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:05.596976 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-20306fa8-8188-49a4-9aa2-c37b60cb085c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:05.597982 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-20306fa8-8188-49a4-9aa2-c37b60cb085c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:05.600181 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-20306fa8-8188-49a4-9aa2-c37b60cb085c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:05.600775 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-20306fa8-8188-49a4-9aa2-c37b60cb085c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:05.665264 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-741b3123-f123-4f47-b260-e0df2f3b078c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:05.680141 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-741b3123-f123-4f47-b260-e0df2f3b078c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.370546 Aug 24 12:33:05.683422 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 24/44] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:05 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:05.689879 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f954e792-5c44-4d83-a694-4b8ce5a4cfb8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:05.690723 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f954e792-5c44-4d83-a694-4b8ce5a4cfb8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:05.699557 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f954e792-5c44-4d83-a694-4b8ce5a4cfb8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:05.700075 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f954e792-5c44-4d83-a694-4b8ce5a4cfb8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:05.701252 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f954e792-5c44-4d83-a694-4b8ce5a4cfb8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:05.702460 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f954e792-5c44-4d83-a694-4b8ce5a4cfb8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:05.703091 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f954e792-5c44-4d83-a694-4b8ce5a4cfb8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:05.703719 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f954e792-5c44-4d83-a694-4b8ce5a4cfb8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:05.834283 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f954e792-5c44-4d83-a694-4b8ce5a4cfb8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:05.847994 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f954e792-5c44-4d83-a694-4b8ce5a4cfb8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1282 microversion: 2.1 time: 0.163052 Aug 24 12:33:05.851327 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 25/45] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:05 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1282 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:05.877852 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4546b56d-6ad6-48ec-b362-02bc159ee991 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:05.886183 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4546b56d-6ad6-48ec-b362-02bc159ee991 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:05.903253 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4546b56d-6ad6-48ec-b362-02bc159ee991 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:05.904786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4546b56d-6ad6-48ec-b362-02bc159ee991 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:05.905958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4546b56d-6ad6-48ec-b362-02bc159ee991 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:05.908732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4546b56d-6ad6-48ec-b362-02bc159ee991 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:05.910949 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4546b56d-6ad6-48ec-b362-02bc159ee991 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:05.912168 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4546b56d-6ad6-48ec-b362-02bc159ee991 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:05.923457 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=100 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:06.026212 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-20306fa8-8188-49a4-9aa2-c37b60cb085c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:06.035154 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-20306fa8-8188-49a4-9aa2-c37b60cb085c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.471358 Aug 24 12:33:06.035763 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 21/46] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:05 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:06.228346 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4546b56d-6ad6-48ec-b362-02bc159ee991 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:06.244346 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4546b56d-6ad6-48ec-b362-02bc159ee991 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:06.245747 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4546b56d-6ad6-48ec-b362-02bc159ee991 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:06.247015 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4546b56d-6ad6-48ec-b362-02bc159ee991 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.380893 Aug 24 12:33:06.247734 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 26/47] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:05 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:33:06.566257 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-be35a9bb-332a-41d7-bc9d-bccaad9543b1 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:06.566871 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-be35a9bb-332a-41d7-bc9d-bccaad9543b1 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:06.572676 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-be35a9bb-332a-41d7-bc9d-bccaad9543b1 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:06.573162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-be35a9bb-332a-41d7-bc9d-bccaad9543b1 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:06.573595 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-be35a9bb-332a-41d7-bc9d-bccaad9543b1 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:06.574281 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-be35a9bb-332a-41d7-bc9d-bccaad9543b1 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:06.574736 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-be35a9bb-332a-41d7-bc9d-bccaad9543b1 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:06.575157 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-be35a9bb-332a-41d7-bc9d-bccaad9543b1 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:06.706592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f4c86014-3521-439e-acc3-34b48811493a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:06.708601 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f4c86014-3521-439e-acc3-34b48811493a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:06.711095 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-be35a9bb-332a-41d7-bc9d-bccaad9543b1 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:06.714692 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f4c86014-3521-439e-acc3-34b48811493a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:06.715374 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f4c86014-3521-439e-acc3-34b48811493a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:06.715838 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f4c86014-3521-439e-acc3-34b48811493a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:06.717190 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f4c86014-3521-439e-acc3-34b48811493a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:06.717790 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f4c86014-3521-439e-acc3-34b48811493a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:06.718377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f4c86014-3521-439e-acc3-34b48811493a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:06.720430 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-be35a9bb-332a-41d7-bc9d-bccaad9543b1 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.157949 Aug 24 12:33:06.721087 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 22/48] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:06 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:06.869516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f4c86014-3521-439e-acc3-34b48811493a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:06.871581 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a2ac702a-cd63-47a3-b13e-599c36ca463c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:06.872248 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a2ac702a-cd63-47a3-b13e-599c36ca463c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:06.880691 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a2ac702a-cd63-47a3-b13e-599c36ca463c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:06.881984 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a2ac702a-cd63-47a3-b13e-599c36ca463c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:06.882289 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f4c86014-3521-439e-acc3-34b48811493a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.180004 Aug 24 12:33:06.882894 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a2ac702a-cd63-47a3-b13e-599c36ca463c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:06.883407 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 27/49] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:06 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:06.884328 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a2ac702a-cd63-47a3-b13e-599c36ca463c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:06.885075 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a2ac702a-cd63-47a3-b13e-599c36ca463c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:06.885861 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a2ac702a-cd63-47a3-b13e-599c36ca463c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:06.947487 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a2ac702a-cd63-47a3-b13e-599c36ca463c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:06.956118 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a2ac702a-cd63-47a3-b13e-599c36ca463c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1282 microversion: 2.1 time: 0.089461 Aug 24 12:33:06.957360 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 23/50] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:06 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:07.058354 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1e581773-8a2d-40f1-9839-5322164dc3aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:07.058979 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1e581773-8a2d-40f1-9839-5322164dc3aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:07.065669 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e581773-8a2d-40f1-9839-5322164dc3aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.066159 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e581773-8a2d-40f1-9839-5322164dc3aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.066601 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e581773-8a2d-40f1-9839-5322164dc3aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.067303 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e581773-8a2d-40f1-9839-5322164dc3aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.067788 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e581773-8a2d-40f1-9839-5322164dc3aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.068217 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e581773-8a2d-40f1-9839-5322164dc3aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.209558 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1e581773-8a2d-40f1-9839-5322164dc3aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:07.218685 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1e581773-8a2d-40f1-9839-5322164dc3aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.164072 Aug 24 12:33:07.219329 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 28/51] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:07 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:07.269746 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-7b37026b-ed50-47b1-8764-da21d62cb425 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:07.270352 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-7b37026b-ed50-47b1-8764-da21d62cb425 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:07.276146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7b37026b-ed50-47b1-8764-da21d62cb425 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.276639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7b37026b-ed50-47b1-8764-da21d62cb425 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.277079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7b37026b-ed50-47b1-8764-da21d62cb425 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.277736 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7b37026b-ed50-47b1-8764-da21d62cb425 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.278341 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7b37026b-ed50-47b1-8764-da21d62cb425 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.278819 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7b37026b-ed50-47b1-8764-da21d62cb425 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.282976 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=85 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:07.435943 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7b37026b-ed50-47b1-8764-da21d62cb425 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:07.444498 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7b37026b-ed50-47b1-8764-da21d62cb425 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:07.446025 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7b37026b-ed50-47b1-8764-da21d62cb425 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:07.447137 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-7b37026b-ed50-47b1-8764-da21d62cb425 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.181236 Aug 24 12:33:07.447706 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 24/52] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:07 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:33:07.741701 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1d593989-8801-44ed-8e62-6977ff898851 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:07.742314 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1d593989-8801-44ed-8e62-6977ff898851 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:07.744177 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:07.750079 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1d593989-8801-44ed-8e62-6977ff898851 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.750610 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1d593989-8801-44ed-8e62-6977ff898851 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.751051 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1d593989-8801-44ed-8e62-6977ff898851 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.751772 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1d593989-8801-44ed-8e62-6977ff898851 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.752224 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1d593989-8801-44ed-8e62-6977ff898851 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.752645 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1d593989-8801-44ed-8e62-6977ff898851 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.896993 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1d593989-8801-44ed-8e62-6977ff898851 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:07.905763 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b8de7c95-382e-4734-90c2-ff67cf4049a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:07.906546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1d593989-8801-44ed-8e62-6977ff898851 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.168535 Aug 24 12:33:07.907132 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 29/53] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:07 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:07.907413 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-b8de7c95-382e-4734-90c2-ff67cf4049a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:07.913535 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b8de7c95-382e-4734-90c2-ff67cf4049a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.914266 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b8de7c95-382e-4734-90c2-ff67cf4049a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.914921 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b8de7c95-382e-4734-90c2-ff67cf4049a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.916114 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b8de7c95-382e-4734-90c2-ff67cf4049a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.916793 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b8de7c95-382e-4734-90c2-ff67cf4049a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.917496 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b8de7c95-382e-4734-90c2-ff67cf4049a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.976617 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-862e3572-a4d1-4913-879a-5a14f0b6c090 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:07.977571 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-862e3572-a4d1-4913-879a-5a14f0b6c090 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:07.986337 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-862e3572-a4d1-4913-879a-5a14f0b6c090 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.986833 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-862e3572-a4d1-4913-879a-5a14f0b6c090 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.987276 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-862e3572-a4d1-4913-879a-5a14f0b6c090 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.988013 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-862e3572-a4d1-4913-879a-5a14f0b6c090 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.988473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-862e3572-a4d1-4913-879a-5a14f0b6c090 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.988898 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-862e3572-a4d1-4913-879a-5a14f0b6c090 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:08.067575 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-862e3572-a4d1-4913-879a-5a14f0b6c090 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:08.079460 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-862e3572-a4d1-4913-879a-5a14f0b6c090 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1282 microversion: 2.1 time: 0.106471 Aug 24 12:33:08.080118 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 30/54] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:07 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1282 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:08.099538 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b8de7c95-382e-4734-90c2-ff67cf4049a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:08.107985 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b8de7c95-382e-4734-90c2-ff67cf4049a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.207937 Aug 24 12:33:08.114286 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 25/55] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:07 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:08.240530 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-85c3367b-831a-4e5c-b3ac-b67619a4bc9b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:08.241144 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-85c3367b-831a-4e5c-b3ac-b67619a4bc9b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:08.247275 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85c3367b-831a-4e5c-b3ac-b67619a4bc9b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:08.247898 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85c3367b-831a-4e5c-b3ac-b67619a4bc9b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:08.248371 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85c3367b-831a-4e5c-b3ac-b67619a4bc9b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:08.249156 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85c3367b-831a-4e5c-b3ac-b67619a4bc9b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:08.249735 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85c3367b-831a-4e5c-b3ac-b67619a4bc9b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:08.250080 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85c3367b-831a-4e5c-b3ac-b67619a4bc9b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:08.471331 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-82564c9d-5489-4aa7-91cc-d4b3957ed9f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:08.472024 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-82564c9d-5489-4aa7-91cc-d4b3957ed9f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:08.486352 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-82564c9d-5489-4aa7-91cc-d4b3957ed9f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:08.487214 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-82564c9d-5489-4aa7-91cc-d4b3957ed9f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:08.487905 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-82564c9d-5489-4aa7-91cc-d4b3957ed9f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:08.488903 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-82564c9d-5489-4aa7-91cc-d4b3957ed9f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:08.489591 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-82564c9d-5489-4aa7-91cc-d4b3957ed9f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:08.490042 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-85c3367b-831a-4e5c-b3ac-b67619a4bc9b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:08.490493 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-82564c9d-5489-4aa7-91cc-d4b3957ed9f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:08.498704 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-85c3367b-831a-4e5c-b3ac-b67619a4bc9b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.261947 Aug 24 12:33:08.512666 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 31/56] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:08 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:08.693999 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-82564c9d-5489-4aa7-91cc-d4b3957ed9f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:08.705735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-82564c9d-5489-4aa7-91cc-d4b3957ed9f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:08.708720 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-82564c9d-5489-4aa7-91cc-d4b3957ed9f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:08.710346 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-82564c9d-5489-4aa7-91cc-d4b3957ed9f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.243351 Aug 24 12:33:08.711543 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 26/57] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:08 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:33:08.929022 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4022b7ee-ae93-4080-bd32-e50bbbed72a4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:08.929632 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4022b7ee-ae93-4080-bd32-e50bbbed72a4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:08.938891 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4022b7ee-ae93-4080-bd32-e50bbbed72a4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:08.939550 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4022b7ee-ae93-4080-bd32-e50bbbed72a4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:08.940920 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4022b7ee-ae93-4080-bd32-e50bbbed72a4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:08.941998 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4022b7ee-ae93-4080-bd32-e50bbbed72a4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:08.942467 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4022b7ee-ae93-4080-bd32-e50bbbed72a4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:08.943448 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4022b7ee-ae93-4080-bd32-e50bbbed72a4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:09.099797 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d0a79478-b266-4695-b3b3-1319d6e1efce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:09.101120 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d0a79478-b266-4695-b3b3-1319d6e1efce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:09.111846 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d0a79478-b266-4695-b3b3-1319d6e1efce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:09.112675 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d0a79478-b266-4695-b3b3-1319d6e1efce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:09.115039 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d0a79478-b266-4695-b3b3-1319d6e1efce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:09.115972 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d0a79478-b266-4695-b3b3-1319d6e1efce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:09.116582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d0a79478-b266-4695-b3b3-1319d6e1efce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:09.117661 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d0a79478-b266-4695-b3b3-1319d6e1efce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:09.197635 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4022b7ee-ae93-4080-bd32-e50bbbed72a4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:09.212274 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4022b7ee-ae93-4080-bd32-e50bbbed72a4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.287466 Aug 24 12:33:09.212868 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 32/58] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:08 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:09.228832 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b63b11a2-3021-4022-a676-f6dc0680b0be tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:09.229462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b63b11a2-3021-4022-a676-f6dc0680b0be tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:09.240789 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b63b11a2-3021-4022-a676-f6dc0680b0be tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:09.241275 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b63b11a2-3021-4022-a676-f6dc0680b0be tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:09.250024 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b63b11a2-3021-4022-a676-f6dc0680b0be tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:09.251146 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b63b11a2-3021-4022-a676-f6dc0680b0be tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:09.251670 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-d0a79478-b266-4695-b3b3-1319d6e1efce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:09.252053 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b63b11a2-3021-4022-a676-f6dc0680b0be tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:09.252669 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b63b11a2-3021-4022-a676-f6dc0680b0be tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:09.266821 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d0a79478-b266-4695-b3b3-1319d6e1efce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1280 microversion: 2.1 time: 0.166035 Aug 24 12:33:09.267520 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 27/59] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:09 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1280 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:09.413571 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b63b11a2-3021-4022-a676-f6dc0680b0be tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:09.422174 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b63b11a2-3021-4022-a676-f6dc0680b0be tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.206560 Aug 24 12:33:09.423398 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 33/60] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:09 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:09.535440 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-840a19f3-a365-4a01-a8ec-3fad156e1d4f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:09.536111 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-840a19f3-a365-4a01-a8ec-3fad156e1d4f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:09.548754 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=34 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:09.564792 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-840a19f3-a365-4a01-a8ec-3fad156e1d4f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:09.567390 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-840a19f3-a365-4a01-a8ec-3fad156e1d4f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:09.567886 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-840a19f3-a365-4a01-a8ec-3fad156e1d4f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:09.572493 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-840a19f3-a365-4a01-a8ec-3fad156e1d4f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:09.572988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-840a19f3-a365-4a01-a8ec-3fad156e1d4f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:09.574029 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-840a19f3-a365-4a01-a8ec-3fad156e1d4f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:09.741822 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-6cab87db-878f-429d-88cd-fa6e6ba094d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:09.742919 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-6cab87db-878f-429d-88cd-fa6e6ba094d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:09.754802 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6cab87db-878f-429d-88cd-fa6e6ba094d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:09.755750 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6cab87db-878f-429d-88cd-fa6e6ba094d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:09.756462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6cab87db-878f-429d-88cd-fa6e6ba094d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:09.757454 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6cab87db-878f-429d-88cd-fa6e6ba094d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:09.758286 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6cab87db-878f-429d-88cd-fa6e6ba094d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:09.758956 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6cab87db-878f-429d-88cd-fa6e6ba094d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:10.135584 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-840a19f3-a365-4a01-a8ec-3fad156e1d4f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:10.145096 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-840a19f3-a365-4a01-a8ec-3fad156e1d4f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.621163 Aug 24 12:33:10.161018 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 28/61] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:09 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:10.237705 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-67ccadc2-b95f-4d0b-bb7b-38b886c2934b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:10.238677 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-67ccadc2-b95f-4d0b-bb7b-38b886c2934b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:10.252254 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67ccadc2-b95f-4d0b-bb7b-38b886c2934b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:10.252466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=6 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:10.253506 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67ccadc2-b95f-4d0b-bb7b-38b886c2934b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:10.254611 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67ccadc2-b95f-4d0b-bb7b-38b886c2934b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:10.257397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67ccadc2-b95f-4d0b-bb7b-38b886c2934b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:10.259033 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67ccadc2-b95f-4d0b-bb7b-38b886c2934b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:10.259491 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67ccadc2-b95f-4d0b-bb7b-38b886c2934b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:10.468744 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6cab87db-878f-429d-88cd-fa6e6ba094d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:10.517426 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6cab87db-878f-429d-88cd-fa6e6ba094d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:10.522198 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6cab87db-878f-429d-88cd-fa6e6ba094d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:10.528400 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-6cab87db-878f-429d-88cd-fa6e6ba094d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.796092 Aug 24 12:33:10.532139 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 34/62] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:09 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:33:10.556199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b29056ec-ede3-44d8-997a-3bb095a1a4bc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:10.556946 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b29056ec-ede3-44d8-997a-3bb095a1a4bc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:10.577885 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b29056ec-ede3-44d8-997a-3bb095a1a4bc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:10.578733 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b29056ec-ede3-44d8-997a-3bb095a1a4bc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:10.579374 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b29056ec-ede3-44d8-997a-3bb095a1a4bc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:10.580473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b29056ec-ede3-44d8-997a-3bb095a1a4bc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:10.581191 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b29056ec-ede3-44d8-997a-3bb095a1a4bc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:10.582832 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b29056ec-ede3-44d8-997a-3bb095a1a4bc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:10.837738 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-67ccadc2-b95f-4d0b-bb7b-38b886c2934b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:10.860257 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-67ccadc2-b95f-4d0b-bb7b-38b886c2934b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.629508 Aug 24 12:33:10.861866 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 29/63] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:10 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:10.870608 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-67e8e030-7a8d-4ff8-b8e5-cd27b2976f9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:10.871703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-67e8e030-7a8d-4ff8-b8e5-cd27b2976f9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:10.883787 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b29056ec-ede3-44d8-997a-3bb095a1a4bc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:10.895595 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b29056ec-ede3-44d8-997a-3bb095a1a4bc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1280 microversion: 2.1 time: 0.362120 Aug 24 12:33:10.896591 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 35/64] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:10 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1280 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:10.902899 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-3527e8ef-ce90-4725-825f-a439240cdca5 req-6571430b-d50f-40e9-90be-81e45ba09e8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e09b5ebb-0578-465d-a6ad-03383fdeca05", "tag": "170ac04a-b7df-4c9d-939a-edc705e2589c"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:10.911713 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67e8e030-7a8d-4ff8-b8e5-cd27b2976f9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:10.913252 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67e8e030-7a8d-4ff8-b8e5-cd27b2976f9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:10.914092 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67e8e030-7a8d-4ff8-b8e5-cd27b2976f9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:10.915212 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-3527e8ef-ce90-4725-825f-a439240cdca5 req-6571430b-d50f-40e9-90be-81e45ba09e8b service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:10.915886 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-3527e8ef-ce90-4725-825f-a439240cdca5 req-6571430b-d50f-40e9-90be-81e45ba09e8b service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:10.916514 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-3527e8ef-ce90-4725-825f-a439240cdca5 req-6571430b-d50f-40e9-90be-81e45ba09e8b service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:10.938375 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67e8e030-7a8d-4ff8-b8e5-cd27b2976f9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:10.938727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-3527e8ef-ce90-4725-825f-a439240cdca5 req-6571430b-d50f-40e9-90be-81e45ba09e8b service nova] Creating event network-changed:170ac04a-b7df-4c9d-939a-edc705e2589c for instance e09b5ebb-0578-465d-a6ad-03383fdeca05 on hv-cinder-84890 Aug 24 12:33:10.939218 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67e8e030-7a8d-4ff8-b8e5-cd27b2976f9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:10.941109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67e8e030-7a8d-4ff8-b8e5-cd27b2976f9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:10.951497 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-3527e8ef-ce90-4725-825f-a439240cdca5 req-6571430b-d50f-40e9-90be-81e45ba09e8b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048990 Aug 24 12:33:10.969660 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 36/65] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:11.185518 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-54a4b7e8-ff27-4861-9da5-060b10159ad1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:11.187728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-54a4b7e8-ff27-4861-9da5-060b10159ad1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:11.223453 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-54a4b7e8-ff27-4861-9da5-060b10159ad1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:11.225095 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-67e8e030-7a8d-4ff8-b8e5-cd27b2976f9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:11.228390 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-54a4b7e8-ff27-4861-9da5-060b10159ad1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:11.233671 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-54a4b7e8-ff27-4861-9da5-060b10159ad1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:11.235766 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-54a4b7e8-ff27-4861-9da5-060b10159ad1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:11.239254 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-67e8e030-7a8d-4ff8-b8e5-cd27b2976f9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.372619 Aug 24 12:33:11.241892 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 30/66] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:10 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:11.243108 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-54a4b7e8-ff27-4861-9da5-060b10159ad1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:11.243721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-54a4b7e8-ff27-4861-9da5-060b10159ad1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:11.557032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8e13f6d1-4140-4a8f-9272-1f87cddac6ce tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:11.558286 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8e13f6d1-4140-4a8f-9272-1f87cddac6ce tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:11.582564 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8e13f6d1-4140-4a8f-9272-1f87cddac6ce tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:11.585549 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8e13f6d1-4140-4a8f-9272-1f87cddac6ce tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:11.586688 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8e13f6d1-4140-4a8f-9272-1f87cddac6ce tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:11.589491 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8e13f6d1-4140-4a8f-9272-1f87cddac6ce tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:11.594619 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8e13f6d1-4140-4a8f-9272-1f87cddac6ce tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:11.595852 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8e13f6d1-4140-4a8f-9272-1f87cddac6ce tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:11.800761 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-54a4b7e8-ff27-4861-9da5-060b10159ad1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:11.811698 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=22 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:11.831391 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-54a4b7e8-ff27-4861-9da5-060b10159ad1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.662457 Aug 24 12:33:11.833191 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 37/67] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:11 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:11.895852 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f49c8dcc-8524-44ec-81fb-a154a10dd50f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:11.897249 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f49c8dcc-8524-44ec-81fb-a154a10dd50f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:11.910505 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8e13f6d1-4140-4a8f-9272-1f87cddac6ce tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:11.921664 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f49c8dcc-8524-44ec-81fb-a154a10dd50f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:11.923014 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8e13f6d1-4140-4a8f-9272-1f87cddac6ce tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:11.923799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f49c8dcc-8524-44ec-81fb-a154a10dd50f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:11.925361 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8e13f6d1-4140-4a8f-9272-1f87cddac6ce tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:11.925943 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f49c8dcc-8524-44ec-81fb-a154a10dd50f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:11.926949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8e13f6d1-4140-4a8f-9272-1f87cddac6ce tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.377116 Aug 24 12:33:11.928032 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f49c8dcc-8524-44ec-81fb-a154a10dd50f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:11.928378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 31/68] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:11 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:33:11.932418 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f49c8dcc-8524-44ec-81fb-a154a10dd50f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:11.932969 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f49c8dcc-8524-44ec-81fb-a154a10dd50f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:11.933977 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a7e749ff-f0a7-4509-92f6-e57012b09e06 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:11.934812 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a7e749ff-f0a7-4509-92f6-e57012b09e06 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:11.952700 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7e749ff-f0a7-4509-92f6-e57012b09e06 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:11.953423 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7e749ff-f0a7-4509-92f6-e57012b09e06 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:11.954232 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7e749ff-f0a7-4509-92f6-e57012b09e06 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:11.955576 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7e749ff-f0a7-4509-92f6-e57012b09e06 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:11.957822 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7e749ff-f0a7-4509-92f6-e57012b09e06 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:11.958572 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7e749ff-f0a7-4509-92f6-e57012b09e06 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:12.090899 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a7e749ff-f0a7-4509-92f6-e57012b09e06 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:12.109036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a7e749ff-f0a7-4509-92f6-e57012b09e06 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1280 microversion: 2.1 time: 0.174394 Aug 24 12:33:12.109942 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 32/69] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:11 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1280 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:12.215148 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f49c8dcc-8524-44ec-81fb-a154a10dd50f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:12.231359 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f49c8dcc-8524-44ec-81fb-a154a10dd50f tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.351682 Aug 24 12:33:12.232651 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 38/70] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:11 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:12.263088 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d476a9e5-f0dd-4661-99ab-4e285c5c5215 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:12.272757 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d476a9e5-f0dd-4661-99ab-4e285c5c5215 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:12.283296 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d476a9e5-f0dd-4661-99ab-4e285c5c5215 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:12.285147 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d476a9e5-f0dd-4661-99ab-4e285c5c5215 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:12.289003 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d476a9e5-f0dd-4661-99ab-4e285c5c5215 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:12.289813 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d476a9e5-f0dd-4661-99ab-4e285c5c5215 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:12.295393 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d476a9e5-f0dd-4661-99ab-4e285c5c5215 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:12.296483 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d476a9e5-f0dd-4661-99ab-4e285c5c5215 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:12.496263 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-d476a9e5-f0dd-4661-99ab-4e285c5c5215 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:12.504555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d476a9e5-f0dd-4661-99ab-4e285c5c5215 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.245587 Aug 24 12:33:12.505742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 33/71] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:12 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:12.855383 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-325d0759-55da-430f-9ce5-b216a4d8203a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:12.856755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-325d0759-55da-430f-9ce5-b216a4d8203a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:12.869711 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-325d0759-55da-430f-9ce5-b216a4d8203a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:12.870613 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-325d0759-55da-430f-9ce5-b216a4d8203a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:12.871217 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-325d0759-55da-430f-9ce5-b216a4d8203a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:12.872141 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-325d0759-55da-430f-9ce5-b216a4d8203a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:12.873325 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-325d0759-55da-430f-9ce5-b216a4d8203a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:12.873754 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-325d0759-55da-430f-9ce5-b216a4d8203a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:12.953829 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6eed27b3-832a-49b6-a984-38bde0485189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:12.955360 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-6eed27b3-832a-49b6-a984-38bde0485189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:12.965449 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6eed27b3-832a-49b6-a984-38bde0485189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:12.966835 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6eed27b3-832a-49b6-a984-38bde0485189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:12.967580 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6eed27b3-832a-49b6-a984-38bde0485189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:12.969140 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6eed27b3-832a-49b6-a984-38bde0485189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:12.969738 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6eed27b3-832a-49b6-a984-38bde0485189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:12.970386 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6eed27b3-832a-49b6-a984-38bde0485189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:13.071411 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-325d0759-55da-430f-9ce5-b216a4d8203a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:13.080631 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-325d0759-55da-430f-9ce5-b216a4d8203a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.229913 Aug 24 12:33:13.081457 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 39/72] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:12 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:13.086713 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-8bf41eb1-679f-4fde-88a8-534b668db32e req-d28ea77f-18c1-464f-9e2f-b321d9fba6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b5f3300-5ec6-4d3e-b94b-23041ffe7bda", "tag": "3830e132-a365-42e2-bb6e-5e8a8b16e891"}, {"name": "network-changed", "server_uuid": "c2cf1c28-43da-4dce-9f29-d2a486ef88ab", "tag": "d41d285f-5608-4807-8786-de42cb2d695e"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:13.097883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-8bf41eb1-679f-4fde-88a8-534b668db32e req-d28ea77f-18c1-464f-9e2f-b321d9fba6c5 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:13.098361 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-8bf41eb1-679f-4fde-88a8-534b668db32e req-d28ea77f-18c1-464f-9e2f-b321d9fba6c5 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:13.099138 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-8bf41eb1-679f-4fde-88a8-534b668db32e req-d28ea77f-18c1-464f-9e2f-b321d9fba6c5 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:13.118253 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-8bf41eb1-679f-4fde-88a8-534b668db32e req-d28ea77f-18c1-464f-9e2f-b321d9fba6c5 service nova] Creating event network-changed:3830e132-a365-42e2-bb6e-5e8a8b16e891 for instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda on hv-cinder-84890 Aug 24 12:33:13.119163 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-8bf41eb1-679f-4fde-88a8-534b668db32e req-d28ea77f-18c1-464f-9e2f-b321d9fba6c5 service nova] Creating event network-changed:d41d285f-5608-4807-8786-de42cb2d695e for instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab on hv-cinder-84890 Aug 24 12:33:13.131337 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-8bf41eb1-679f-4fde-88a8-534b668db32e req-d28ea77f-18c1-464f-9e2f-b321d9fba6c5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048517 Aug 24 12:33:13.132105 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 40/73] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:13.137435 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-147bde1a-4008-42cd-9b4c-f4e1f91571ba tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:13.138750 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-147bde1a-4008-42cd-9b4c-f4e1f91571ba tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:13.146259 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-147bde1a-4008-42cd-9b4c-f4e1f91571ba tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:13.146821 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-147bde1a-4008-42cd-9b4c-f4e1f91571ba tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:13.147535 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-147bde1a-4008-42cd-9b4c-f4e1f91571ba tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:13.148620 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-147bde1a-4008-42cd-9b4c-f4e1f91571ba tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:13.149322 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-147bde1a-4008-42cd-9b4c-f4e1f91571ba tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:13.149807 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-147bde1a-4008-42cd-9b4c-f4e1f91571ba tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:13.180764 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6eed27b3-832a-49b6-a984-38bde0485189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:13.192880 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6eed27b3-832a-49b6-a984-38bde0485189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:13.198663 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6eed27b3-832a-49b6-a984-38bde0485189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:13.201871 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-6eed27b3-832a-49b6-a984-38bde0485189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.254536 Aug 24 12:33:13.221002 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 34/74] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:12 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:33:13.255275 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-47aebb02-7126-48fe-87df-c92d36cccd03 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:13.257038 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-47aebb02-7126-48fe-87df-c92d36cccd03 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:13.264501 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-47aebb02-7126-48fe-87df-c92d36cccd03 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:13.265863 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-47aebb02-7126-48fe-87df-c92d36cccd03 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:13.267940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-47aebb02-7126-48fe-87df-c92d36cccd03 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:13.269500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-47aebb02-7126-48fe-87df-c92d36cccd03 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:13.270732 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-47aebb02-7126-48fe-87df-c92d36cccd03 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:13.271380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-47aebb02-7126-48fe-87df-c92d36cccd03 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:13.485183 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-147bde1a-4008-42cd-9b4c-f4e1f91571ba tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:13.495566 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-147bde1a-4008-42cd-9b4c-f4e1f91571ba tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1322 microversion: 2.1 time: 0.361931 Aug 24 12:33:13.496162 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 41/75] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:13 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:13.527125 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d2b8162f-e8b9-4e74-8832-cb3a6432ac34 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:13.527911 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d2b8162f-e8b9-4e74-8832-cb3a6432ac34 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:13.537431 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d2b8162f-e8b9-4e74-8832-cb3a6432ac34 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:13.539737 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d2b8162f-e8b9-4e74-8832-cb3a6432ac34 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:13.546406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d2b8162f-e8b9-4e74-8832-cb3a6432ac34 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:13.547140 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d2b8162f-e8b9-4e74-8832-cb3a6432ac34 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:13.548951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d2b8162f-e8b9-4e74-8832-cb3a6432ac34 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:13.549381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d2b8162f-e8b9-4e74-8832-cb3a6432ac34 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:13.587966 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-47aebb02-7126-48fe-87df-c92d36cccd03 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:13.599965 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-47aebb02-7126-48fe-87df-c92d36cccd03 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.350322 Aug 24 12:33:13.600553 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 35/76] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:13 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:13.802526 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d2b8162f-e8b9-4e74-8832-cb3a6432ac34 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:13.811328 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d2b8162f-e8b9-4e74-8832-cb3a6432ac34 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.289402 Aug 24 12:33:13.811951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 42/77] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:13 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:14.103660 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-4210a1a6-f631-4ef8-aff5-440b015b7b87 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:14.104289 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-4210a1a6-f631-4ef8-aff5-440b015b7b87 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:14.115196 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4210a1a6-f631-4ef8-aff5-440b015b7b87 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:14.115739 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4210a1a6-f631-4ef8-aff5-440b015b7b87 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:14.116192 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4210a1a6-f631-4ef8-aff5-440b015b7b87 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:14.116906 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4210a1a6-f631-4ef8-aff5-440b015b7b87 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:14.117371 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4210a1a6-f631-4ef8-aff5-440b015b7b87 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:14.121787 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4210a1a6-f631-4ef8-aff5-440b015b7b87 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:14.235022 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ad82526b-e095-487e-a145-d42408a52c67 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:14.236489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-ad82526b-e095-487e-a145-d42408a52c67 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:14.246591 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ad82526b-e095-487e-a145-d42408a52c67 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:14.248610 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ad82526b-e095-487e-a145-d42408a52c67 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:14.250116 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ad82526b-e095-487e-a145-d42408a52c67 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:14.251809 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ad82526b-e095-487e-a145-d42408a52c67 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:14.254681 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ad82526b-e095-487e-a145-d42408a52c67 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:14.255782 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ad82526b-e095-487e-a145-d42408a52c67 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:14.384186 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-4210a1a6-f631-4ef8-aff5-440b015b7b87 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:14.401252 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-4210a1a6-f631-4ef8-aff5-440b015b7b87 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.302200 Aug 24 12:33:14.411663 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 36/78] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:14 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:14.562961 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=10 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:14.706476 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-6fd5dfe9-7659-47c7-bae3-eba38c758f72 req-17753047-f158-4028-aa09-553bb939da30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46eaa161-78d7-4c8a-9fe7-f1accd97238a", "name": "network-vif-plugged", "status": "completed", "tag": "6e8bd6e8-d063-4381-b0f9-4b7b031b124e"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:14.727974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-6fd5dfe9-7659-47c7-bae3-eba38c758f72 req-17753047-f158-4028-aa09-553bb939da30 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:14.729489 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-6fd5dfe9-7659-47c7-bae3-eba38c758f72 req-17753047-f158-4028-aa09-553bb939da30 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:14.730547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-6fd5dfe9-7659-47c7-bae3-eba38c758f72 req-17753047-f158-4028-aa09-553bb939da30 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:14.746853 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ad82526b-e095-487e-a145-d42408a52c67 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:14.749539 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-6fd5dfe9-7659-47c7-bae3-eba38c758f72 req-17753047-f158-4028-aa09-553bb939da30 service nova] Creating event network-vif-plugged:6e8bd6e8-d063-4381-b0f9-4b7b031b124e for instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a on hv-cinder-84890 Aug 24 12:33:14.757914 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-6fd5dfe9-7659-47c7-bae3-eba38c758f72 req-17753047-f158-4028-aa09-553bb939da30 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.354230 Aug 24 12:33:14.759650 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 37/79] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:14.771547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-bcf9d4f2-34f7-4233-baae-65c26fbe2187 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:14.772795 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-bcf9d4f2-34f7-4233-baae-65c26fbe2187 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:14.776707 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ad82526b-e095-487e-a145-d42408a52c67 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:14.780725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ad82526b-e095-487e-a145-d42408a52c67 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:14.782410 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcf9d4f2-34f7-4233-baae-65c26fbe2187 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:14.783128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcf9d4f2-34f7-4233-baae-65c26fbe2187 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:14.785327 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcf9d4f2-34f7-4233-baae-65c26fbe2187 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:14.786927 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcf9d4f2-34f7-4233-baae-65c26fbe2187 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:14.787527 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-ad82526b-e095-487e-a145-d42408a52c67 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.551855 Aug 24 12:33:14.787973 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcf9d4f2-34f7-4233-baae-65c26fbe2187 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:14.788386 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 43/80] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:14 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:33:14.789120 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcf9d4f2-34f7-4233-baae-65c26fbe2187 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:14.799606 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-83c9fb42-0257-48ea-8dc2-b699467cfe3c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:14.800734 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-83c9fb42-0257-48ea-8dc2-b699467cfe3c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:14.812017 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-83c9fb42-0257-48ea-8dc2-b699467cfe3c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:14.812909 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-83c9fb42-0257-48ea-8dc2-b699467cfe3c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:14.813636 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-83c9fb42-0257-48ea-8dc2-b699467cfe3c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:14.814816 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-83c9fb42-0257-48ea-8dc2-b699467cfe3c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:14.815502 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-83c9fb42-0257-48ea-8dc2-b699467cfe3c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:14.816287 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-83c9fb42-0257-48ea-8dc2-b699467cfe3c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:14.821553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=100 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:15.082076 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-bcf9d4f2-34f7-4233-baae-65c26fbe2187 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:15.090531 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-83c9fb42-0257-48ea-8dc2-b699467cfe3c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:15.100211 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-83c9fb42-0257-48ea-8dc2-b699467cfe3c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.310545 Aug 24 12:33:15.100787 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 44/81] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:14 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:15.105166 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-beabf29b-546f-48d4-aaa9-20575bfd78de tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:15.105765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-beabf29b-546f-48d4-aaa9-20575bfd78de tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:15.108272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-bcf9d4f2-34f7-4233-baae-65c26fbe2187 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1322 microversion: 2.1 time: 0.346703 Aug 24 12:33:15.109118 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 38/82] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:14 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:15.114995 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-beabf29b-546f-48d4-aaa9-20575bfd78de tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:15.115593 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-beabf29b-546f-48d4-aaa9-20575bfd78de tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:15.116200 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-beabf29b-546f-48d4-aaa9-20575bfd78de tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:15.117096 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-beabf29b-546f-48d4-aaa9-20575bfd78de tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:15.117646 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-beabf29b-546f-48d4-aaa9-20575bfd78de tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:15.118169 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-beabf29b-546f-48d4-aaa9-20575bfd78de tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:15.228281 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-e833c640-7132-4a8b-b33e-8de0870c2e6e req-a3a5559d-a2c4-4a57-a218-c9b00688a334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8467a7d-419f-4ec3-a8c5-d513d1ef2149", "tag": "14960f8e-911e-4c24-a6f8-8995dd4f8bab"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:15.255138 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-e833c640-7132-4a8b-b33e-8de0870c2e6e req-a3a5559d-a2c4-4a57-a218-c9b00688a334 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:15.256526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-e833c640-7132-4a8b-b33e-8de0870c2e6e req-a3a5559d-a2c4-4a57-a218-c9b00688a334 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:15.266867 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-e833c640-7132-4a8b-b33e-8de0870c2e6e req-a3a5559d-a2c4-4a57-a218-c9b00688a334 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:15.282151 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-e833c640-7132-4a8b-b33e-8de0870c2e6e req-a3a5559d-a2c4-4a57-a218-c9b00688a334 service nova] Creating event network-changed:14960f8e-911e-4c24-a6f8-8995dd4f8bab for instance d8467a7d-419f-4ec3-a8c5-d513d1ef2149 on hv-cinder-84890 Aug 24 12:33:15.289162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-e833c640-7132-4a8b-b33e-8de0870c2e6e req-a3a5559d-a2c4-4a57-a218-c9b00688a334 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064367 Aug 24 12:33:15.290252 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 39/83] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:15.353350 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-beabf29b-546f-48d4-aaa9-20575bfd78de tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:15.365963 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-beabf29b-546f-48d4-aaa9-20575bfd78de tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.264066 Aug 24 12:33:15.366967 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 45/84] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:15 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:15.427055 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-964639e7-8aee-4033-b97c-2c3cfd0e7c58 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:15.427945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-964639e7-8aee-4033-b97c-2c3cfd0e7c58 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:15.439391 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-964639e7-8aee-4033-b97c-2c3cfd0e7c58 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:15.440103 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-964639e7-8aee-4033-b97c-2c3cfd0e7c58 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:15.441561 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-964639e7-8aee-4033-b97c-2c3cfd0e7c58 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:15.442556 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-964639e7-8aee-4033-b97c-2c3cfd0e7c58 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:15.446424 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-964639e7-8aee-4033-b97c-2c3cfd0e7c58 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:15.447007 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-964639e7-8aee-4033-b97c-2c3cfd0e7c58 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:15.606402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-964639e7-8aee-4033-b97c-2c3cfd0e7c58 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:15.616558 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-964639e7-8aee-4033-b97c-2c3cfd0e7c58 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.194386 Aug 24 12:33:15.624702 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 40/85] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:15 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:15.811963 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ed110d40-7b1b-4b13-bf39-7bc6e8892dd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:15.812947 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-ed110d40-7b1b-4b13-bf39-7bc6e8892dd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:15.823463 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ed110d40-7b1b-4b13-bf39-7bc6e8892dd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:15.825341 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ed110d40-7b1b-4b13-bf39-7bc6e8892dd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:15.826476 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ed110d40-7b1b-4b13-bf39-7bc6e8892dd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:15.834144 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ed110d40-7b1b-4b13-bf39-7bc6e8892dd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:15.835159 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ed110d40-7b1b-4b13-bf39-7bc6e8892dd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:15.836289 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ed110d40-7b1b-4b13-bf39-7bc6e8892dd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:16.070929 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ed110d40-7b1b-4b13-bf39-7bc6e8892dd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:16.087616 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ed110d40-7b1b-4b13-bf39-7bc6e8892dd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:16.094914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ed110d40-7b1b-4b13-bf39-7bc6e8892dd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:16.098297 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-ed110d40-7b1b-4b13-bf39-7bc6e8892dd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.291682 Aug 24 12:33:16.100706 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 46/86] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:15 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:33:16.128315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3ba94e40-88fd-47ca-9fad-7b4efbdfb6a8 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:16.129088 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3ba94e40-88fd-47ca-9fad-7b4efbdfb6a8 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:16.142334 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-926b8b19-13bc-4a9b-8990-c1816deeae95 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:16.143248 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ba94e40-88fd-47ca-9fad-7b4efbdfb6a8 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:16.146625 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-926b8b19-13bc-4a9b-8990-c1816deeae95 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:16.147175 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ba94e40-88fd-47ca-9fad-7b4efbdfb6a8 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:16.148033 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ba94e40-88fd-47ca-9fad-7b4efbdfb6a8 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:16.154756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ba94e40-88fd-47ca-9fad-7b4efbdfb6a8 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:16.157398 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ba94e40-88fd-47ca-9fad-7b4efbdfb6a8 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:16.158363 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ba94e40-88fd-47ca-9fad-7b4efbdfb6a8 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:16.166663 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-926b8b19-13bc-4a9b-8990-c1816deeae95 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:16.167394 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-926b8b19-13bc-4a9b-8990-c1816deeae95 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:16.168015 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-926b8b19-13bc-4a9b-8990-c1816deeae95 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:16.171332 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-926b8b19-13bc-4a9b-8990-c1816deeae95 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:16.173343 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-926b8b19-13bc-4a9b-8990-c1816deeae95 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:16.175261 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-926b8b19-13bc-4a9b-8990-c1816deeae95 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:16.530822 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-3ba94e40-88fd-47ca-9fad-7b4efbdfb6a8 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:16.540653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3ba94e40-88fd-47ca-9fad-7b4efbdfb6a8 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.419200 Aug 24 12:33:16.549850 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 41/87] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:16 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:16.549850 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e580c06a-0a50-45b8-b864-3d616f5689a2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:16.549850 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e580c06a-0a50-45b8-b864-3d616f5689a2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:16.553711 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e580c06a-0a50-45b8-b864-3d616f5689a2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:16.554216 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e580c06a-0a50-45b8-b864-3d616f5689a2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:16.554701 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e580c06a-0a50-45b8-b864-3d616f5689a2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:16.555528 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e580c06a-0a50-45b8-b864-3d616f5689a2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:16.555999 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e580c06a-0a50-45b8-b864-3d616f5689a2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:16.556535 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e580c06a-0a50-45b8-b864-3d616f5689a2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:16.561625 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=100 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:16.564564 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-926b8b19-13bc-4a9b-8990-c1816deeae95 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:16.576512 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-926b8b19-13bc-4a9b-8990-c1816deeae95 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1322 microversion: 2.1 time: 0.450941 Aug 24 12:33:16.578457 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 47/88] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:16 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:16.640474 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-fb026402-013f-4af7-bcf0-5ac693fb1b6d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:16.641168 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-fb026402-013f-4af7-bcf0-5ac693fb1b6d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:16.647995 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb026402-013f-4af7-bcf0-5ac693fb1b6d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:16.648759 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb026402-013f-4af7-bcf0-5ac693fb1b6d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:16.649358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb026402-013f-4af7-bcf0-5ac693fb1b6d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:16.650102 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb026402-013f-4af7-bcf0-5ac693fb1b6d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:16.650860 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb026402-013f-4af7-bcf0-5ac693fb1b6d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:16.651516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb026402-013f-4af7-bcf0-5ac693fb1b6d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:16.852109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e580c06a-0a50-45b8-b864-3d616f5689a2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:16.861425 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e580c06a-0a50-45b8-b864-3d616f5689a2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.318528 Aug 24 12:33:16.862010 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 42/89] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:16 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:16.867679 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-9aee58e0-800d-4694-8b0e-09c9b1abbd81 req-f11fc514-0ae6-4106-b45f-83cfd38b8ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3027685-43d2-43dc-92d2-ac44b036c061", "name": "network-vif-plugged", "status": "completed", "tag": "c9418bfd-867a-4096-a9ce-235b0174885a"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:16.884763 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-9aee58e0-800d-4694-8b0e-09c9b1abbd81 req-f11fc514-0ae6-4106-b45f-83cfd38b8ec5 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:16.885602 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-9aee58e0-800d-4694-8b0e-09c9b1abbd81 req-f11fc514-0ae6-4106-b45f-83cfd38b8ec5 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:16.886213 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-9aee58e0-800d-4694-8b0e-09c9b1abbd81 req-f11fc514-0ae6-4106-b45f-83cfd38b8ec5 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:16.898532 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-9aee58e0-800d-4694-8b0e-09c9b1abbd81 req-f11fc514-0ae6-4106-b45f-83cfd38b8ec5 service nova] Creating event network-vif-plugged:c9418bfd-867a-4096-a9ce-235b0174885a for instance a3027685-43d2-43dc-92d2-ac44b036c061 on hv-cinder-84890 Aug 24 12:33:16.903554 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-9aee58e0-800d-4694-8b0e-09c9b1abbd81 req-f11fc514-0ae6-4106-b45f-83cfd38b8ec5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040209 Aug 24 12:33:16.904728 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 43/90] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:16.910562 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-fb026402-013f-4af7-bcf0-5ac693fb1b6d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:16.919733 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-fb026402-013f-4af7-bcf0-5ac693fb1b6d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.284642 Aug 24 12:33:16.930192 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 48/91] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:16 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:17.130084 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6eb0c679-bc08-462b-8767-e2d69dbba29a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:17.130882 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-6eb0c679-bc08-462b-8767-e2d69dbba29a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:17.137358 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6eb0c679-bc08-462b-8767-e2d69dbba29a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:17.138880 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6eb0c679-bc08-462b-8767-e2d69dbba29a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:17.139308 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6eb0c679-bc08-462b-8767-e2d69dbba29a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:17.140025 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6eb0c679-bc08-462b-8767-e2d69dbba29a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:17.140475 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6eb0c679-bc08-462b-8767-e2d69dbba29a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:17.140900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6eb0c679-bc08-462b-8767-e2d69dbba29a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:17.284987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6eb0c679-bc08-462b-8767-e2d69dbba29a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:17.305828 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6eb0c679-bc08-462b-8767-e2d69dbba29a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:17.308099 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6eb0c679-bc08-462b-8767-e2d69dbba29a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:17.312742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-6eb0c679-bc08-462b-8767-e2d69dbba29a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.183906 Aug 24 12:33:17.317814 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 44/92] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:17 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:33:17.561725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9082420a-07bd-446c-9b41-7a2b82c8cd71 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:17.562583 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9082420a-07bd-446c-9b41-7a2b82c8cd71 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:17.568834 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9082420a-07bd-446c-9b41-7a2b82c8cd71 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:17.569434 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9082420a-07bd-446c-9b41-7a2b82c8cd71 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:17.569739 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9082420a-07bd-446c-9b41-7a2b82c8cd71 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:17.570433 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9082420a-07bd-446c-9b41-7a2b82c8cd71 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:17.570878 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9082420a-07bd-446c-9b41-7a2b82c8cd71 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:17.571458 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9082420a-07bd-446c-9b41-7a2b82c8cd71 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:17.597069 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9b1e6586-f080-4978-8198-2dc95df8054b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:17.598354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-9b1e6586-f080-4978-8198-2dc95df8054b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:17.608233 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b1e6586-f080-4978-8198-2dc95df8054b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:17.608717 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b1e6586-f080-4978-8198-2dc95df8054b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:17.610553 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b1e6586-f080-4978-8198-2dc95df8054b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:17.612000 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b1e6586-f080-4978-8198-2dc95df8054b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:17.613929 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b1e6586-f080-4978-8198-2dc95df8054b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:17.615350 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b1e6586-f080-4978-8198-2dc95df8054b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:17.833292 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9082420a-07bd-446c-9b41-7a2b82c8cd71 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:17.838559 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-9b1e6586-f080-4978-8198-2dc95df8054b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:17.843890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9082420a-07bd-446c-9b41-7a2b82c8cd71 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.284159 Aug 24 12:33:17.844675 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 49/93] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:17 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:17.847348 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9b1e6586-f080-4978-8198-2dc95df8054b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1322 microversion: 2.1 time: 0.253983 Aug 24 12:33:17.860173 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 45/94] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:17 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:17.884074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-33fd25e8-4b51-4100-94d2-e62a21f4cc9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:17.885533 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-33fd25e8-4b51-4100-94d2-e62a21f4cc9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:17.895161 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-33fd25e8-4b51-4100-94d2-e62a21f4cc9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:17.895934 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-33fd25e8-4b51-4100-94d2-e62a21f4cc9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:17.896587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-33fd25e8-4b51-4100-94d2-e62a21f4cc9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:17.897318 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-33fd25e8-4b51-4100-94d2-e62a21f4cc9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:17.897816 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-33fd25e8-4b51-4100-94d2-e62a21f4cc9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:17.898731 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-33fd25e8-4b51-4100-94d2-e62a21f4cc9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:17.940510 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9427678a-9405-4678-bee7-ca4eecc18c1c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:17.941201 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-9427678a-9405-4678-bee7-ca4eecc18c1c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:17.947312 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9427678a-9405-4678-bee7-ca4eecc18c1c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:17.947837 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9427678a-9405-4678-bee7-ca4eecc18c1c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:17.948276 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9427678a-9405-4678-bee7-ca4eecc18c1c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:17.948976 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9427678a-9405-4678-bee7-ca4eecc18c1c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:17.949430 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9427678a-9405-4678-bee7-ca4eecc18c1c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:17.949850 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9427678a-9405-4678-bee7-ca4eecc18c1c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:18.108172 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-33fd25e8-4b51-4100-94d2-e62a21f4cc9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:18.117613 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-33fd25e8-4b51-4100-94d2-e62a21f4cc9a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.237367 Aug 24 12:33:18.121407 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 50/95] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:17 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:18.144327 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-9427678a-9405-4678-bee7-ca4eecc18c1c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:18.152449 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9427678a-9405-4678-bee7-ca4eecc18c1c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.215516 Aug 24 12:33:18.152615 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 46/96] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:17 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:18.348489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-65431cb1-1b96-4c22-aa32-d6c90737b9a8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:18.349368 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-65431cb1-1b96-4c22-aa32-d6c90737b9a8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:18.355580 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-65431cb1-1b96-4c22-aa32-d6c90737b9a8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:18.356106 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-65431cb1-1b96-4c22-aa32-d6c90737b9a8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:18.356566 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-65431cb1-1b96-4c22-aa32-d6c90737b9a8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:18.361121 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-65431cb1-1b96-4c22-aa32-d6c90737b9a8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:18.361121 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-65431cb1-1b96-4c22-aa32-d6c90737b9a8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:18.361121 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-65431cb1-1b96-4c22-aa32-d6c90737b9a8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:18.768071 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-65431cb1-1b96-4c22-aa32-d6c90737b9a8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:18.776106 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-65431cb1-1b96-4c22-aa32-d6c90737b9a8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:18.777611 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-65431cb1-1b96-4c22-aa32-d6c90737b9a8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:18.779292 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-65431cb1-1b96-4c22-aa32-d6c90737b9a8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.434179 Aug 24 12:33:18.779943 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 51/97] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:18 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:33:18.864712 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-dc537eb1-a626-4c06-b39d-7ccada191e5c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:18.866075 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-dc537eb1-a626-4c06-b39d-7ccada191e5c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:18.868826 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-5fb2dbb2-3178-40d5-944b-c68fd68a83e4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:18.869436 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-5fb2dbb2-3178-40d5-944b-c68fd68a83e4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:18.873235 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dc537eb1-a626-4c06-b39d-7ccada191e5c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:18.879646 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5fb2dbb2-3178-40d5-944b-c68fd68a83e4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:18.879646 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5fb2dbb2-3178-40d5-944b-c68fd68a83e4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:18.879646 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5fb2dbb2-3178-40d5-944b-c68fd68a83e4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:18.880425 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dc537eb1-a626-4c06-b39d-7ccada191e5c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:18.881134 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dc537eb1-a626-4c06-b39d-7ccada191e5c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:18.882136 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dc537eb1-a626-4c06-b39d-7ccada191e5c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:18.882788 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dc537eb1-a626-4c06-b39d-7ccada191e5c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:18.883423 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dc537eb1-a626-4c06-b39d-7ccada191e5c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:18.887588 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5fb2dbb2-3178-40d5-944b-c68fd68a83e4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:18.888763 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5fb2dbb2-3178-40d5-944b-c68fd68a83e4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:18.889588 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5fb2dbb2-3178-40d5-944b-c68fd68a83e4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:19.318251 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-5fb2dbb2-3178-40d5-944b-c68fd68a83e4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:19.332198 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-5fb2dbb2-3178-40d5-944b-c68fd68a83e4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1322 microversion: 2.1 time: 0.467520 Aug 24 12:33:19.352300 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 52/98] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:18 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1322 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:19.362302 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-dc537eb1-a626-4c06-b39d-7ccada191e5c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:19.380939 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-dc537eb1-a626-4c06-b39d-7ccada191e5c tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.520251 Aug 24 12:33:19.394950 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-195ccf79-a151-4400-83ce-95471cf7e248 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:19.397426 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 47/99] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:18 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:19.398798 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-195ccf79-a151-4400-83ce-95471cf7e248 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:19.405960 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-edbd90cb-22aa-4b0f-9200-b8905b1573c9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:19.408893 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-edbd90cb-22aa-4b0f-9200-b8905b1573c9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:19.425496 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-195ccf79-a151-4400-83ce-95471cf7e248 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:19.428196 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-edbd90cb-22aa-4b0f-9200-b8905b1573c9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:19.428348 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-195ccf79-a151-4400-83ce-95471cf7e248 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:19.429149 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-edbd90cb-22aa-4b0f-9200-b8905b1573c9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:19.429547 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-195ccf79-a151-4400-83ce-95471cf7e248 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:19.430103 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-edbd90cb-22aa-4b0f-9200-b8905b1573c9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:19.430986 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-edbd90cb-22aa-4b0f-9200-b8905b1573c9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:19.431586 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-edbd90cb-22aa-4b0f-9200-b8905b1573c9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:19.433235 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-195ccf79-a151-4400-83ce-95471cf7e248 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:19.434189 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-edbd90cb-22aa-4b0f-9200-b8905b1573c9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:19.438945 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-195ccf79-a151-4400-83ce-95471cf7e248 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:19.438945 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-195ccf79-a151-4400-83ce-95471cf7e248 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:19.857904 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-edbd90cb-22aa-4b0f-9200-b8905b1573c9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:19.867011 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-edbd90cb-22aa-4b0f-9200-b8905b1573c9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.467710 Aug 24 12:33:19.876848 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 48/100] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:19 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:19.893294 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-f74e0152-8d54-4962-a992-d3cf79984957 req-97646285-5301-4ee2-9f4a-176eadc4a48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09b5ebb-0578-465d-a6ad-03383fdeca05", "name": "network-vif-plugged", "status": "completed", "tag": "170ac04a-b7df-4c9d-939a-edc705e2589c"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:19.899406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-195ccf79-a151-4400-83ce-95471cf7e248 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:19.908383 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-195ccf79-a151-4400-83ce-95471cf7e248 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.554909 Aug 24 12:33:19.909472 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-f74e0152-8d54-4962-a992-d3cf79984957 req-97646285-5301-4ee2-9f4a-176eadc4a48f service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:19.909635 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 53/101] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:19 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:19.910485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-f74e0152-8d54-4962-a992-d3cf79984957 req-97646285-5301-4ee2-9f4a-176eadc4a48f service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:19.910933 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-f74e0152-8d54-4962-a992-d3cf79984957 req-97646285-5301-4ee2-9f4a-176eadc4a48f service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:19.915800 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-00604ff8-a19b-43fc-a44b-3481e65d7b76 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:19.917005 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-00604ff8-a19b-43fc-a44b-3481e65d7b76 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:19.924441 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-00604ff8-a19b-43fc-a44b-3481e65d7b76 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:19.925302 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-00604ff8-a19b-43fc-a44b-3481e65d7b76 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:19.925770 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-f74e0152-8d54-4962-a992-d3cf79984957 req-97646285-5301-4ee2-9f4a-176eadc4a48f service nova] Creating event network-vif-plugged:170ac04a-b7df-4c9d-939a-edc705e2589c for instance e09b5ebb-0578-465d-a6ad-03383fdeca05 on hv-cinder-84890 Aug 24 12:33:19.926232 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-00604ff8-a19b-43fc-a44b-3481e65d7b76 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:19.927158 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-00604ff8-a19b-43fc-a44b-3481e65d7b76 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:19.927849 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-00604ff8-a19b-43fc-a44b-3481e65d7b76 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:19.928489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-00604ff8-a19b-43fc-a44b-3481e65d7b76 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:19.931730 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-f74e0152-8d54-4962-a992-d3cf79984957 req-97646285-5301-4ee2-9f4a-176eadc4a48f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061231 Aug 24 12:33:19.932969 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 49/102] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:20.154543 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-00604ff8-a19b-43fc-a44b-3481e65d7b76 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:20.164897 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-00604ff8-a19b-43fc-a44b-3481e65d7b76 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:20.166527 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-00604ff8-a19b-43fc-a44b-3481e65d7b76 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:20.167786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-00604ff8-a19b-43fc-a44b-3481e65d7b76 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.256154 Aug 24 12:33:20.168407 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 54/103] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:19 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:33:20.358724 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c06f91d8-53e3-4c88-8ef1-005ac79d8e0d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:20.359419 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c06f91d8-53e3-4c88-8ef1-005ac79d8e0d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:20.365829 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c06f91d8-53e3-4c88-8ef1-005ac79d8e0d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:20.366309 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c06f91d8-53e3-4c88-8ef1-005ac79d8e0d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:20.366791 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c06f91d8-53e3-4c88-8ef1-005ac79d8e0d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:20.367685 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c06f91d8-53e3-4c88-8ef1-005ac79d8e0d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:20.368206 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c06f91d8-53e3-4c88-8ef1-005ac79d8e0d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:20.368703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c06f91d8-53e3-4c88-8ef1-005ac79d8e0d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:20.402567 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-702f9ad0-9389-4226-b0e8-f4e3f0c61997 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:20.403219 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-702f9ad0-9389-4226-b0e8-f4e3f0c61997 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:20.410280 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-702f9ad0-9389-4226-b0e8-f4e3f0c61997 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:20.410763 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-702f9ad0-9389-4226-b0e8-f4e3f0c61997 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:20.411216 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-702f9ad0-9389-4226-b0e8-f4e3f0c61997 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:20.411924 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-702f9ad0-9389-4226-b0e8-f4e3f0c61997 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:20.412378 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-702f9ad0-9389-4226-b0e8-f4e3f0c61997 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:20.412797 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-702f9ad0-9389-4226-b0e8-f4e3f0c61997 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:20.557554 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c06f91d8-53e3-4c88-8ef1-005ac79d8e0d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:20.569736 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c06f91d8-53e3-4c88-8ef1-005ac79d8e0d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1322 microversion: 2.1 time: 0.215665 Aug 24 12:33:20.570317 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 50/104] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:20 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:20.596834 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-702f9ad0-9389-4226-b0e8-f4e3f0c61997 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:20.604827 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-702f9ad0-9389-4226-b0e8-f4e3f0c61997 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.206425 Aug 24 12:33:20.605380 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 55/105] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:20 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:20.888179 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9e89aef0-c618-404f-b388-68c9d26672ef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:20.888819 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-9e89aef0-c618-404f-b388-68c9d26672ef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:20.895455 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9e89aef0-c618-404f-b388-68c9d26672ef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:20.895966 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9e89aef0-c618-404f-b388-68c9d26672ef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:20.896402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9e89aef0-c618-404f-b388-68c9d26672ef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:20.897086 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9e89aef0-c618-404f-b388-68c9d26672ef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:20.897533 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9e89aef0-c618-404f-b388-68c9d26672ef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:20.897957 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9e89aef0-c618-404f-b388-68c9d26672ef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:20.929793 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2a8b3fff-3be3-421d-acd0-8d8e534f0d6d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:20.930399 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2a8b3fff-3be3-421d-acd0-8d8e534f0d6d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:20.936363 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2a8b3fff-3be3-421d-acd0-8d8e534f0d6d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:20.937518 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2a8b3fff-3be3-421d-acd0-8d8e534f0d6d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:20.938057 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2a8b3fff-3be3-421d-acd0-8d8e534f0d6d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:20.938756 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2a8b3fff-3be3-421d-acd0-8d8e534f0d6d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:20.939210 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2a8b3fff-3be3-421d-acd0-8d8e534f0d6d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:20.939648 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2a8b3fff-3be3-421d-acd0-8d8e534f0d6d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:21.084837 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-9e89aef0-c618-404f-b388-68c9d26672ef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:21.095474 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9e89aef0-c618-404f-b388-68c9d26672ef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.210998 Aug 24 12:33:21.096250 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 51/106] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:20 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:21.115461 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2a8b3fff-3be3-421d-acd0-8d8e534f0d6d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:21.127493 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2a8b3fff-3be3-421d-acd0-8d8e534f0d6d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.201366 Aug 24 12:33:21.128098 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 56/107] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:20 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:21.212523 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-48d60e9a-325c-4586-b681-f611facc7596 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:21.213449 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-48d60e9a-325c-4586-b681-f611facc7596 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:21.229466 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-48d60e9a-325c-4586-b681-f611facc7596 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:21.229966 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-48d60e9a-325c-4586-b681-f611facc7596 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:21.230405 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-48d60e9a-325c-4586-b681-f611facc7596 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:21.231115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-48d60e9a-325c-4586-b681-f611facc7596 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:21.231569 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-48d60e9a-325c-4586-b681-f611facc7596 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:21.232021 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-48d60e9a-325c-4586-b681-f611facc7596 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:21.459815 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-48d60e9a-325c-4586-b681-f611facc7596 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:21.472229 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-48d60e9a-325c-4586-b681-f611facc7596 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:21.474295 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-48d60e9a-325c-4586-b681-f611facc7596 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:21.476626 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-48d60e9a-325c-4586-b681-f611facc7596 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.281146 Aug 24 12:33:21.478370 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 52/108] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:21 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:33:21.590808 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-5bdc2793-4610-43f0-a670-8edaae69e27c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:21.591340 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-5bdc2793-4610-43f0-a670-8edaae69e27c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:21.607093 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bdc2793-4610-43f0-a670-8edaae69e27c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:21.607093 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bdc2793-4610-43f0-a670-8edaae69e27c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:21.607980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bdc2793-4610-43f0-a670-8edaae69e27c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:21.609868 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bdc2793-4610-43f0-a670-8edaae69e27c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:21.617766 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bdc2793-4610-43f0-a670-8edaae69e27c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:21.618379 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bdc2793-4610-43f0-a670-8edaae69e27c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:21.636250 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-926bdbfe-503c-454b-b074-80256b8ce0fe tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:21.640024 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-926bdbfe-503c-454b-b074-80256b8ce0fe tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:21.664088 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-926bdbfe-503c-454b-b074-80256b8ce0fe tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:21.666741 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-926bdbfe-503c-454b-b074-80256b8ce0fe tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:21.669979 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-926bdbfe-503c-454b-b074-80256b8ce0fe tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:21.674783 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-926bdbfe-503c-454b-b074-80256b8ce0fe tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:21.676919 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-926bdbfe-503c-454b-b074-80256b8ce0fe tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:21.680093 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-926bdbfe-503c-454b-b074-80256b8ce0fe tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:21.983044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-5bdc2793-4610-43f0-a670-8edaae69e27c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:21.988805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-926bdbfe-503c-454b-b074-80256b8ce0fe tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:21.995004 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-5bdc2793-4610-43f0-a670-8edaae69e27c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1322 microversion: 2.1 time: 0.408571 Aug 24 12:33:21.996302 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 57/109] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:21 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:22.010230 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-926bdbfe-503c-454b-b074-80256b8ce0fe tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1314 microversion: 2.1 time: 0.384467 Aug 24 12:33:22.012192 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 53/110] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:21 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:22.116511 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b9796967-c42f-4ca7-8bf8-b0e05cbc4127 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:22.117054 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b9796967-c42f-4ca7-8bf8-b0e05cbc4127 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:22.122991 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b9796967-c42f-4ca7-8bf8-b0e05cbc4127 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:22.123465 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b9796967-c42f-4ca7-8bf8-b0e05cbc4127 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:22.123967 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b9796967-c42f-4ca7-8bf8-b0e05cbc4127 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:22.124851 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b9796967-c42f-4ca7-8bf8-b0e05cbc4127 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:22.125294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b9796967-c42f-4ca7-8bf8-b0e05cbc4127 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:22.125713 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b9796967-c42f-4ca7-8bf8-b0e05cbc4127 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:22.148976 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-19b77795-8601-4bf4-80c2-f9f4de66c8b4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:22.149690 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-19b77795-8601-4bf4-80c2-f9f4de66c8b4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:22.157859 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19b77795-8601-4bf4-80c2-f9f4de66c8b4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:22.158502 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19b77795-8601-4bf4-80c2-f9f4de66c8b4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:22.158756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19b77795-8601-4bf4-80c2-f9f4de66c8b4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:22.159469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19b77795-8601-4bf4-80c2-f9f4de66c8b4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:22.159930 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19b77795-8601-4bf4-80c2-f9f4de66c8b4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:22.160499 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19b77795-8601-4bf4-80c2-f9f4de66c8b4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:22.317114 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b9796967-c42f-4ca7-8bf8-b0e05cbc4127 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:22.328369 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b9796967-c42f-4ca7-8bf8-b0e05cbc4127 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.214544 Aug 24 12:33:22.330128 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 58/111] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:22 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:22.370171 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-19b77795-8601-4bf4-80c2-f9f4de66c8b4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:22.385844 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-19b77795-8601-4bf4-80c2-f9f4de66c8b4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.240795 Aug 24 12:33:22.408143 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 54/112] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:22 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:22.506027 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-5208c376-cd26-4378-b976-1a035b90595e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:22.506626 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-5208c376-cd26-4378-b976-1a035b90595e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:22.512559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5208c376-cd26-4378-b976-1a035b90595e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:22.513035 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5208c376-cd26-4378-b976-1a035b90595e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:22.513460 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5208c376-cd26-4378-b976-1a035b90595e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:22.514128 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5208c376-cd26-4378-b976-1a035b90595e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:22.514576 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5208c376-cd26-4378-b976-1a035b90595e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:22.514984 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5208c376-cd26-4378-b976-1a035b90595e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:22.645447 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-5208c376-cd26-4378-b976-1a035b90595e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:22.653472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-5208c376-cd26-4378-b976-1a035b90595e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:22.654955 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-5208c376-cd26-4378-b976-1a035b90595e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:22.656891 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-5208c376-cd26-4378-b976-1a035b90595e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.154791 Aug 24 12:33:22.657442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 59/113] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:22 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:33:23.018155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-950e024b-25b6-4f35-b0bb-012faefa7c25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:23.018824 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-950e024b-25b6-4f35-b0bb-012faefa7c25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:23.024844 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-950e024b-25b6-4f35-b0bb-012faefa7c25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.025330 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-950e024b-25b6-4f35-b0bb-012faefa7c25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.025934 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-950e024b-25b6-4f35-b0bb-012faefa7c25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.026464 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-950e024b-25b6-4f35-b0bb-012faefa7c25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.032781 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-348b0592-27a8-4904-9866-15486969448d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:23.033335 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-348b0592-27a8-4904-9866-15486969448d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:23.039194 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-950e024b-25b6-4f35-b0bb-012faefa7c25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.040021 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-950e024b-25b6-4f35-b0bb-012faefa7c25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.042832 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-348b0592-27a8-4904-9866-15486969448d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.047027 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-348b0592-27a8-4904-9866-15486969448d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.048936 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-348b0592-27a8-4904-9866-15486969448d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.049697 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-348b0592-27a8-4904-9866-15486969448d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.050161 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-348b0592-27a8-4904-9866-15486969448d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.050598 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-348b0592-27a8-4904-9866-15486969448d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.319774 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-950e024b-25b6-4f35-b0bb-012faefa7c25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:23.330847 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-950e024b-25b6-4f35-b0bb-012faefa7c25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1322 microversion: 2.1 time: 0.317211 Aug 24 12:33:23.340993 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-348b0592-27a8-4904-9866-15486969448d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:23.348046 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=100 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:23.356896 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 55/114] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:23 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:23.368703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-1d7c8414-90f3-4928-ba66-c0c1e04657aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:23.370060 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-348b0592-27a8-4904-9866-15486969448d tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1501 microversion: 2.1 time: 0.341963 Aug 24 12:33:23.370991 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 60/115] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:23 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1501 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:23.374737 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-1d7c8414-90f3-4928-ba66-c0c1e04657aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:23.383680 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1d7c8414-90f3-4928-ba66-c0c1e04657aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.384316 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1d7c8414-90f3-4928-ba66-c0c1e04657aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.384998 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1d7c8414-90f3-4928-ba66-c0c1e04657aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.387289 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1d7c8414-90f3-4928-ba66-c0c1e04657aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.387901 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1d7c8414-90f3-4928-ba66-c0c1e04657aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.388405 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1d7c8414-90f3-4928-ba66-c0c1e04657aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.416138 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-cfec6db1-9e1c-42bc-9780-dfda533c4ff9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:23.417148 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-cfec6db1-9e1c-42bc-9780-dfda533c4ff9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:23.423928 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cfec6db1-9e1c-42bc-9780-dfda533c4ff9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.424696 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cfec6db1-9e1c-42bc-9780-dfda533c4ff9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.425358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cfec6db1-9e1c-42bc-9780-dfda533c4ff9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.426504 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cfec6db1-9e1c-42bc-9780-dfda533c4ff9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.427349 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cfec6db1-9e1c-42bc-9780-dfda533c4ff9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.427868 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cfec6db1-9e1c-42bc-9780-dfda533c4ff9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.601485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-1d7c8414-90f3-4928-ba66-c0c1e04657aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:23.613544 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-1d7c8414-90f3-4928-ba66-c0c1e04657aa tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.255005 Aug 24 12:33:23.614799 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 56/116] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:23 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:23.629180 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cfec6db1-9e1c-42bc-9780-dfda533c4ff9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:23.637695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-cfec6db1-9e1c-42bc-9780-dfda533c4ff9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.225739 Aug 24 12:33:23.638256 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 61/117] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:23 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:23.680035 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e5551059-acc3-4215-a38c-942fcc09c189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:23.680560 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e5551059-acc3-4215-a38c-942fcc09c189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:23.687166 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e5551059-acc3-4215-a38c-942fcc09c189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.687678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e5551059-acc3-4215-a38c-942fcc09c189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.688110 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e5551059-acc3-4215-a38c-942fcc09c189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.688836 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e5551059-acc3-4215-a38c-942fcc09c189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.689284 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e5551059-acc3-4215-a38c-942fcc09c189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.689703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e5551059-acc3-4215-a38c-942fcc09c189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.992460 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e5551059-acc3-4215-a38c-942fcc09c189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:24.002092 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e5551059-acc3-4215-a38c-942fcc09c189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:24.003606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e5551059-acc3-4215-a38c-942fcc09c189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:24.004747 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e5551059-acc3-4215-a38c-942fcc09c189 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1408 microversion: 2.20 time: 0.328914 Aug 24 12:33:24.005311 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 57/118] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:23 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1408 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:33:24.383945 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-aca6fe6c-747a-425e-b411-0d3b4f8fa97b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:24.384811 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-aca6fe6c-747a-425e-b411-0d3b4f8fa97b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:24.392091 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-aca6fe6c-747a-425e-b411-0d3b4f8fa97b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:24.392578 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-aca6fe6c-747a-425e-b411-0d3b4f8fa97b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:24.393008 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-aca6fe6c-747a-425e-b411-0d3b4f8fa97b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:24.393943 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-aca6fe6c-747a-425e-b411-0d3b4f8fa97b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:24.394497 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-aca6fe6c-747a-425e-b411-0d3b4f8fa97b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:24.395018 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-aca6fe6c-747a-425e-b411-0d3b4f8fa97b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:24.635062 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6e224035-c9b8-4cff-bced-a78e51ba8479 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:24.635699 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-6e224035-c9b8-4cff-bced-a78e51ba8479 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:24.642492 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e224035-c9b8-4cff-bced-a78e51ba8479 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:24.643303 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e224035-c9b8-4cff-bced-a78e51ba8479 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:24.643842 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e224035-c9b8-4cff-bced-a78e51ba8479 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:24.645261 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e224035-c9b8-4cff-bced-a78e51ba8479 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:24.646160 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e224035-c9b8-4cff-bced-a78e51ba8479 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:24.646813 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e224035-c9b8-4cff-bced-a78e51ba8479 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:24.657975 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-aca6fe6c-747a-425e-b411-0d3b4f8fa97b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:24.673174 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-aca6fe6c-747a-425e-b411-0d3b4f8fa97b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1322 microversion: 2.1 time: 0.294030 Aug 24 12:33:24.674216 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 62/119] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:24 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:24.679245 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-eb9f48fc-eeba-4cf5-abf7-ffab5cb8d0c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:24.680149 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-eb9f48fc-eeba-4cf5-abf7-ffab5cb8d0c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:24.688342 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-eb9f48fc-eeba-4cf5-abf7-ffab5cb8d0c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:24.689065 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-eb9f48fc-eeba-4cf5-abf7-ffab5cb8d0c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:24.689674 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-eb9f48fc-eeba-4cf5-abf7-ffab5cb8d0c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:24.690815 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-eb9f48fc-eeba-4cf5-abf7-ffab5cb8d0c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:24.692373 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-eb9f48fc-eeba-4cf5-abf7-ffab5cb8d0c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:24.692952 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-eb9f48fc-eeba-4cf5-abf7-ffab5cb8d0c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:24.896213 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-eb9f48fc-eeba-4cf5-abf7-ffab5cb8d0c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:24.899615 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6e224035-c9b8-4cff-bced-a78e51ba8479 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:24.912509 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-6e224035-c9b8-4cff-bced-a78e51ba8479 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.282007 Aug 24 12:33:24.913450 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-eb9f48fc-eeba-4cf5-abf7-ffab5cb8d0c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.237851 Aug 24 12:33:24.913568 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 58/120] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:24 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:24.918908 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3f53e317-3b24-4f31-a50c-e3376b744e36 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c74059c2-1096-4a23-904d-d7cf092926c5"}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:24.921672 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3f53e317-3b24-4f31-a50c-e3376b744e36 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:24.926537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 63/121] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:24 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:24.931762 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3f53e317-3b24-4f31-a50c-e3376b744e36 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:24.932256 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3f53e317-3b24-4f31-a50c-e3376b744e36 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:24.932690 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3f53e317-3b24-4f31-a50c-e3376b744e36 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:24.933397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3f53e317-3b24-4f31-a50c-e3376b744e36 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:24.933934 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3f53e317-3b24-4f31-a50c-e3376b744e36 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:24.934367 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3f53e317-3b24-4f31-a50c-e3376b744e36 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.029676 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-92be3db4-ab88-4056-8a57-c3760bf12410 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:25.031943 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-92be3db4-ab88-4056-8a57-c3760bf12410 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:25.040158 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-92be3db4-ab88-4056-8a57-c3760bf12410 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.040933 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-92be3db4-ab88-4056-8a57-c3760bf12410 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.041683 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-92be3db4-ab88-4056-8a57-c3760bf12410 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.042710 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-92be3db4-ab88-4056-8a57-c3760bf12410 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.043650 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-92be3db4-ab88-4056-8a57-c3760bf12410 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.044420 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-92be3db4-ab88-4056-8a57-c3760bf12410 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.179304 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=100 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:25.263202 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-92be3db4-ab88-4056-8a57-c3760bf12410 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:25.276512 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-92be3db4-ab88-4056-8a57-c3760bf12410 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:25.278324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-92be3db4-ab88-4056-8a57-c3760bf12410 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:25.279880 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-92be3db4-ab88-4056-8a57-c3760bf12410 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1599 microversion: 2.20 time: 0.255628 Aug 24 12:33:25.281565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 64/122] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:33:25 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1599 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:33:25.288629 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-cd0b12de-587a-4c6d-93a0-9733304b6977 req-feed3f0b-31ad-4a87-8f31-db54ce15e916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cf1c28-43da-4dce-9f29-d2a486ef88ab", "name": "network-vif-plugged", "status": "completed", "tag": "d41d285f-5608-4807-8786-de42cb2d695e"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:25.299525 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-cd0b12de-587a-4c6d-93a0-9733304b6977 req-feed3f0b-31ad-4a87-8f31-db54ce15e916 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.300168 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-cd0b12de-587a-4c6d-93a0-9733304b6977 req-feed3f0b-31ad-4a87-8f31-db54ce15e916 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.300851 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-cd0b12de-587a-4c6d-93a0-9733304b6977 req-feed3f0b-31ad-4a87-8f31-db54ce15e916 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.345099 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-cd0b12de-587a-4c6d-93a0-9733304b6977 req-feed3f0b-31ad-4a87-8f31-db54ce15e916 service nova] Creating event network-vif-plugged:d41d285f-5608-4807-8786-de42cb2d695e for instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab on hv-cinder-84890 Aug 24 12:33:25.350820 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-cd0b12de-587a-4c6d-93a0-9733304b6977 req-feed3f0b-31ad-4a87-8f31-db54ce15e916 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067551 Aug 24 12:33:25.352305 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 65/123] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:25.363935 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9ab18eef-2e62-449b-9fa1-306135dc4827 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:25.364725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9ab18eef-2e62-449b-9fa1-306135dc4827 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:25.372727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ab18eef-2e62-449b-9fa1-306135dc4827 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.374410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ab18eef-2e62-449b-9fa1-306135dc4827 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.375053 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ab18eef-2e62-449b-9fa1-306135dc4827 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.376075 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ab18eef-2e62-449b-9fa1-306135dc4827 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.379165 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ab18eef-2e62-449b-9fa1-306135dc4827 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.379934 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ab18eef-2e62-449b-9fa1-306135dc4827 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.445317 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3f53e317-3b24-4f31-a50c-e3376b744e36 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "POST /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.530405 Aug 24 12:33:25.446593 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 59/124] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 12:33:24 2022] POST /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a/os-volume_attachments => generated 194 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:25.570823 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9ab18eef-2e62-449b-9fa1-306135dc4827 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.212251 Aug 24 12:33:25.571455 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 66/125] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 24 12:33:25 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/os-interface => generated 284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:33:25.696628 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-30068461-04a0-46fd-a113-5cb3a2701e63 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:25.697339 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-30068461-04a0-46fd-a113-5cb3a2701e63 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:25.710972 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-30068461-04a0-46fd-a113-5cb3a2701e63 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.711776 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-30068461-04a0-46fd-a113-5cb3a2701e63 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.712215 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-30068461-04a0-46fd-a113-5cb3a2701e63 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.712921 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-30068461-04a0-46fd-a113-5cb3a2701e63 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.714509 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-30068461-04a0-46fd-a113-5cb3a2701e63 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.715197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-30068461-04a0-46fd-a113-5cb3a2701e63 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.935259 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-717e7ea1-2832-4f34-8cb4-34b757c28e24 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:25.936155 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-717e7ea1-2832-4f34-8cb4-34b757c28e24 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:25.948210 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-30068461-04a0-46fd-a113-5cb3a2701e63 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:25.959379 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-30068461-04a0-46fd-a113-5cb3a2701e63 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1322 microversion: 2.1 time: 0.268843 Aug 24 12:33:25.960631 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 60/126] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:25 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:25.967452 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a64a8cf4-337a-4001-95b0-ebf44d70f206 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:25.968886 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-717e7ea1-2832-4f34-8cb4-34b757c28e24 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.969635 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a64a8cf4-337a-4001-95b0-ebf44d70f206 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:25.970756 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-717e7ea1-2832-4f34-8cb4-34b757c28e24 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.973195 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-717e7ea1-2832-4f34-8cb4-34b757c28e24 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.974541 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-717e7ea1-2832-4f34-8cb4-34b757c28e24 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.977805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a64a8cf4-337a-4001-95b0-ebf44d70f206 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.978602 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a64a8cf4-337a-4001-95b0-ebf44d70f206 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.978746 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-717e7ea1-2832-4f34-8cb4-34b757c28e24 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.979485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a64a8cf4-337a-4001-95b0-ebf44d70f206 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.980302 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a64a8cf4-337a-4001-95b0-ebf44d70f206 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.980545 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-717e7ea1-2832-4f34-8cb4-34b757c28e24 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.981186 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a64a8cf4-337a-4001-95b0-ebf44d70f206 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.981830 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a64a8cf4-337a-4001-95b0-ebf44d70f206 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:26.283076 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a64a8cf4-337a-4001-95b0-ebf44d70f206 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:26.293658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-717e7ea1-2832-4f34-8cb4-34b757c28e24 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:26.305502 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a64a8cf4-337a-4001-95b0-ebf44d70f206 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.343547 Aug 24 12:33:26.306132 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 61/127] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:25 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:26.316129 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-717e7ea1-2832-4f34-8cb4-34b757c28e24 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.376575 Aug 24 12:33:26.320195 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 67/128] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:25 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:26.981072 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a6663960-c391-4c72-8c38-72f0c6b8e264 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:26.981721 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a6663960-c391-4c72-8c38-72f0c6b8e264 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:26.988410 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a6663960-c391-4c72-8c38-72f0c6b8e264 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:26.989195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a6663960-c391-4c72-8c38-72f0c6b8e264 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:26.989730 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a6663960-c391-4c72-8c38-72f0c6b8e264 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:26.990509 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a6663960-c391-4c72-8c38-72f0c6b8e264 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:26.991172 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a6663960-c391-4c72-8c38-72f0c6b8e264 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:26.991817 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a6663960-c391-4c72-8c38-72f0c6b8e264 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:27.149231 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a6663960-c391-4c72-8c38-72f0c6b8e264 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:27.160234 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a6663960-c391-4c72-8c38-72f0c6b8e264 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1322 microversion: 2.1 time: 0.182868 Aug 24 12:33:27.161152 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 62/129] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:26 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:27.329320 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ac36e78c-7805-4f32-90aa-f0ca9215ea4d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:27.330191 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-ac36e78c-7805-4f32-90aa-f0ca9215ea4d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:27.343280 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d5fb183d-2be2-451d-9150-be45826247c7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:27.344224 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d5fb183d-2be2-451d-9150-be45826247c7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:27.350628 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=100 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:27.351907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ac36e78c-7805-4f32-90aa-f0ca9215ea4d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:27.352961 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d5fb183d-2be2-451d-9150-be45826247c7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:27.353542 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ac36e78c-7805-4f32-90aa-f0ca9215ea4d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:27.353683 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d5fb183d-2be2-451d-9150-be45826247c7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:27.353994 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ac36e78c-7805-4f32-90aa-f0ca9215ea4d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:27.354383 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d5fb183d-2be2-451d-9150-be45826247c7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:27.355194 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d5fb183d-2be2-451d-9150-be45826247c7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:27.355865 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d5fb183d-2be2-451d-9150-be45826247c7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:27.356271 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d5fb183d-2be2-451d-9150-be45826247c7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:27.360791 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ac36e78c-7805-4f32-90aa-f0ca9215ea4d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:27.366852 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ac36e78c-7805-4f32-90aa-f0ca9215ea4d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:27.367556 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ac36e78c-7805-4f32-90aa-f0ca9215ea4d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:27.846511 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-d5fb183d-2be2-451d-9150-be45826247c7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:27.863522 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d5fb183d-2be2-451d-9150-be45826247c7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1359 microversion: 2.1 time: 0.524524 Aug 24 12:33:27.865374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 63/130] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:27 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1359 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:27.883888 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ac36e78c-7805-4f32-90aa-f0ca9215ea4d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:27.892727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-ac36e78c-7805-4f32-90aa-f0ca9215ea4d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.568804 Aug 24 12:33:27.905035 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 68/131] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:27 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:27.913133 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-2d333fff-666a-4ec7-a8d8-c06802e09154 req-708bb0d9-4876-4493-bef7-152495709c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e09b5ebb-0578-465d-a6ad-03383fdeca05", "tag": "170ac04a-b7df-4c9d-939a-edc705e2589c"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:27.919466 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-4936aa83-7293-4257-aa97-f72fd192ad3d req-1e524d45-b8ed-47bb-9644-cb364bf1e49c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8467a7d-419f-4ec3-a8c5-d513d1ef2149", "name": "network-vif-plugged", "status": "completed", "tag": "14960f8e-911e-4c24-a6f8-8995dd4f8bab"}, {"server_uuid": "3b5f3300-5ec6-4d3e-b94b-23041ffe7bda", "name": "network-vif-plugged", "status": "completed", "tag": "3830e132-a365-42e2-bb6e-5e8a8b16e891"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:27.924188 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-2d333fff-666a-4ec7-a8d8-c06802e09154 req-708bb0d9-4876-4493-bef7-152495709c07 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:27.925318 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-2d333fff-666a-4ec7-a8d8-c06802e09154 req-708bb0d9-4876-4493-bef7-152495709c07 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:27.925840 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-2d333fff-666a-4ec7-a8d8-c06802e09154 req-708bb0d9-4876-4493-bef7-152495709c07 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:27.940999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-2d333fff-666a-4ec7-a8d8-c06802e09154 req-708bb0d9-4876-4493-bef7-152495709c07 service nova] Creating event network-changed:170ac04a-b7df-4c9d-939a-edc705e2589c for instance e09b5ebb-0578-465d-a6ad-03383fdeca05 on hv-cinder-84890 Aug 24 12:33:27.946749 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-2d333fff-666a-4ec7-a8d8-c06802e09154 req-708bb0d9-4876-4493-bef7-152495709c07 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039998 Aug 24 12:33:27.947593 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 69/132] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:27.962555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-4936aa83-7293-4257-aa97-f72fd192ad3d req-1e524d45-b8ed-47bb-9644-cb364bf1e49c service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:27.962896 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-4936aa83-7293-4257-aa97-f72fd192ad3d req-1e524d45-b8ed-47bb-9644-cb364bf1e49c service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:27.963337 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-4936aa83-7293-4257-aa97-f72fd192ad3d req-1e524d45-b8ed-47bb-9644-cb364bf1e49c service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.002088 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-4936aa83-7293-4257-aa97-f72fd192ad3d req-1e524d45-b8ed-47bb-9644-cb364bf1e49c service nova] Creating event network-vif-plugged:14960f8e-911e-4c24-a6f8-8995dd4f8bab for instance d8467a7d-419f-4ec3-a8c5-d513d1ef2149 on hv-cinder-84890 Aug 24 12:33:28.004144 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-4936aa83-7293-4257-aa97-f72fd192ad3d req-1e524d45-b8ed-47bb-9644-cb364bf1e49c service nova] Creating event network-vif-plugged:3830e132-a365-42e2-bb6e-5e8a8b16e891 for instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda on hv-cinder-84890 Aug 24 12:33:28.018844 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-4936aa83-7293-4257-aa97-f72fd192ad3d req-1e524d45-b8ed-47bb-9644-cb364bf1e49c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.151242 Aug 24 12:33:28.020694 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 64/133] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:28.182065 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-77fa9b3f-bfd8-49a8-a62e-0a34e8fb1bf6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:28.182678 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-77fa9b3f-bfd8-49a8-a62e-0a34e8fb1bf6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:28.189478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77fa9b3f-bfd8-49a8-a62e-0a34e8fb1bf6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.190021 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77fa9b3f-bfd8-49a8-a62e-0a34e8fb1bf6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.191591 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77fa9b3f-bfd8-49a8-a62e-0a34e8fb1bf6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.191591 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77fa9b3f-bfd8-49a8-a62e-0a34e8fb1bf6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.192380 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77fa9b3f-bfd8-49a8-a62e-0a34e8fb1bf6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.192997 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77fa9b3f-bfd8-49a8-a62e-0a34e8fb1bf6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.429387 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-77fa9b3f-bfd8-49a8-a62e-0a34e8fb1bf6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:28.438501 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-77fa9b3f-bfd8-49a8-a62e-0a34e8fb1bf6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1322 microversion: 2.1 time: 0.260701 Aug 24 12:33:28.439076 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 70/134] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:28 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:28.890391 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-80c68a2d-ebc4-423e-995d-51baa349416c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:28.891159 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-80c68a2d-ebc4-423e-995d-51baa349416c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:28.905607 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-80c68a2d-ebc4-423e-995d-51baa349416c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.906536 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-80c68a2d-ebc4-423e-995d-51baa349416c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.907166 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-80c68a2d-ebc4-423e-995d-51baa349416c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.908453 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-80c68a2d-ebc4-423e-995d-51baa349416c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.908923 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-80c68a2d-ebc4-423e-995d-51baa349416c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.909350 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-80c68a2d-ebc4-423e-995d-51baa349416c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.918427 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-5fef04c8-6a7e-420a-a64d-747467253398 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:28.919598 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-5fef04c8-6a7e-420a-a64d-747467253398 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:28.927534 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5fef04c8-6a7e-420a-a64d-747467253398 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.928260 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5fef04c8-6a7e-420a-a64d-747467253398 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.929095 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5fef04c8-6a7e-420a-a64d-747467253398 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.929971 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5fef04c8-6a7e-420a-a64d-747467253398 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.930653 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5fef04c8-6a7e-420a-a64d-747467253398 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.931269 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5fef04c8-6a7e-420a-a64d-747467253398 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.165574 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-80c68a2d-ebc4-423e-995d-51baa349416c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:29.177754 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-80c68a2d-ebc4-423e-995d-51baa349416c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1546 microversion: 2.1 time: 0.295203 Aug 24 12:33:29.178437 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 65/135] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:28 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1546 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:29.181039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-5fef04c8-6a7e-420a-a64d-747467253398 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:29.190249 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-5fef04c8-6a7e-420a-a64d-747467253398 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1363 microversion: 2.1 time: 0.276435 Aug 24 12:33:29.190979 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 71/136] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:28 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:29.204592 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-536a7ada-ad64-4f00-a946-6f794d6a5577 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:29.205051 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-536a7ada-ad64-4f00-a946-6f794d6a5577 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:29.210877 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-536a7ada-ad64-4f00-a946-6f794d6a5577 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.211354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-536a7ada-ad64-4f00-a946-6f794d6a5577 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.211821 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-536a7ada-ad64-4f00-a946-6f794d6a5577 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.212510 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-536a7ada-ad64-4f00-a946-6f794d6a5577 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.212962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-536a7ada-ad64-4f00-a946-6f794d6a5577 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.213387 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-536a7ada-ad64-4f00-a946-6f794d6a5577 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.289889 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-536a7ada-ad64-4f00-a946-6f794d6a5577 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093748 Aug 24 12:33:29.290483 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 66/137] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 12:33:29 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:29.459976 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f865f9a1-3fef-4cb6-b5e8-46f1abea7c9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:29.460499 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f865f9a1-3fef-4cb6-b5e8-46f1abea7c9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:29.466436 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f865f9a1-3fef-4cb6-b5e8-46f1abea7c9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.466925 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f865f9a1-3fef-4cb6-b5e8-46f1abea7c9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.467361 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f865f9a1-3fef-4cb6-b5e8-46f1abea7c9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.468742 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f865f9a1-3fef-4cb6-b5e8-46f1abea7c9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.469200 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f865f9a1-3fef-4cb6-b5e8-46f1abea7c9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.469625 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f865f9a1-3fef-4cb6-b5e8-46f1abea7c9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.692015 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f865f9a1-3fef-4cb6-b5e8-46f1abea7c9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:29.699555 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f865f9a1-3fef-4cb6-b5e8-46f1abea7c9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1322 microversion: 2.1 time: 0.243931 Aug 24 12:33:29.700155 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 72/138] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:29 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:30.218323 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9fbe4c94-f5de-481b-bb4b-77ec32a6d833 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:30.222207 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-9fbe4c94-f5de-481b-bb4b-77ec32a6d833 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:30.229564 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fbe4c94-f5de-481b-bb4b-77ec32a6d833 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.231035 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fbe4c94-f5de-481b-bb4b-77ec32a6d833 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.231759 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fbe4c94-f5de-481b-bb4b-77ec32a6d833 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.232654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fbe4c94-f5de-481b-bb4b-77ec32a6d833 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.233497 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fbe4c94-f5de-481b-bb4b-77ec32a6d833 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.234390 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fbe4c94-f5de-481b-bb4b-77ec32a6d833 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.663697 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-9fbe4c94-f5de-481b-bb4b-77ec32a6d833 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:30.683765 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9fbe4c94-f5de-481b-bb4b-77ec32a6d833 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1553 microversion: 2.1 time: 0.473484 Aug 24 12:33:30.686372 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 67/139] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:30 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1553 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:30.719769 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-86405b1a-374f-4245-8b05-8036ce89b76f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:30.720318 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-86405b1a-374f-4245-8b05-8036ce89b76f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:30.720971 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-85078d0e-26ff-4c03-832a-38b9a647c504 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:30.722093 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-85078d0e-26ff-4c03-832a-38b9a647c504 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:30.726663 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-86405b1a-374f-4245-8b05-8036ce89b76f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.727160 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-86405b1a-374f-4245-8b05-8036ce89b76f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.727594 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-86405b1a-374f-4245-8b05-8036ce89b76f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.728486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-86405b1a-374f-4245-8b05-8036ce89b76f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.729096 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-86405b1a-374f-4245-8b05-8036ce89b76f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.729665 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-86405b1a-374f-4245-8b05-8036ce89b76f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.731966 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85078d0e-26ff-4c03-832a-38b9a647c504 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.732468 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85078d0e-26ff-4c03-832a-38b9a647c504 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.732914 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85078d0e-26ff-4c03-832a-38b9a647c504 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.734846 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85078d0e-26ff-4c03-832a-38b9a647c504 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.735307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85078d0e-26ff-4c03-832a-38b9a647c504 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.735770 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85078d0e-26ff-4c03-832a-38b9a647c504 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.912170 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-86405b1a-374f-4245-8b05-8036ce89b76f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.198771 Aug 24 12:33:30.913140 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 73/140] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 12:33:30 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:30.934352 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-01f21fb2-e573-430c-83a3-671b0c139a14 req-e2bd4492-37f0-4f3a-bad0-0f0838d7da45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2cf1c28-43da-4dce-9f29-d2a486ef88ab", "tag": "d41d285f-5608-4807-8786-de42cb2d695e"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:30.950437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-01f21fb2-e573-430c-83a3-671b0c139a14 req-e2bd4492-37f0-4f3a-bad0-0f0838d7da45 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.950919 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-01f21fb2-e573-430c-83a3-671b0c139a14 req-e2bd4492-37f0-4f3a-bad0-0f0838d7da45 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.951363 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-01f21fb2-e573-430c-83a3-671b0c139a14 req-e2bd4492-37f0-4f3a-bad0-0f0838d7da45 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.971022 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-01f21fb2-e573-430c-83a3-671b0c139a14 req-e2bd4492-37f0-4f3a-bad0-0f0838d7da45 service nova] Creating event network-changed:d41d285f-5608-4807-8786-de42cb2d695e for instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab on hv-cinder-84890 Aug 24 12:33:30.978697 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-01f21fb2-e573-430c-83a3-671b0c139a14 req-e2bd4492-37f0-4f3a-bad0-0f0838d7da45 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048395 Aug 24 12:33:30.980784 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 74/141] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:33:31.014832 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-85078d0e-26ff-4c03-832a-38b9a647c504 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:31.023065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-85078d0e-26ff-4c03-832a-38b9a647c504 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1322 microversion: 2.1 time: 0.307007 Aug 24 12:33:31.023943 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 68/142] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:30 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:32.039933 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-43d9832f-d69a-4cff-86d1-8f68d1031236 req-093a2917-f840-415f-8408-b806958625a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b5f3300-5ec6-4d3e-b94b-23041ffe7bda", "tag": "3830e132-a365-42e2-bb6e-5e8a8b16e891"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:32.057550 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-43d9832f-d69a-4cff-86d1-8f68d1031236 req-093a2917-f840-415f-8408-b806958625a4 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.058235 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-43d9832f-d69a-4cff-86d1-8f68d1031236 req-093a2917-f840-415f-8408-b806958625a4 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.058836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-43d9832f-d69a-4cff-86d1-8f68d1031236 req-093a2917-f840-415f-8408-b806958625a4 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.066936 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-bcd0df81-71bb-470a-8ee4-f386606bfa30 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:32.067582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-bcd0df81-71bb-470a-8ee4-f386606bfa30 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:32.074694 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-43d9832f-d69a-4cff-86d1-8f68d1031236 req-093a2917-f840-415f-8408-b806958625a4 service nova] Creating event network-changed:3830e132-a365-42e2-bb6e-5e8a8b16e891 for instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda on hv-cinder-84890 Aug 24 12:33:32.083364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcd0df81-71bb-470a-8ee4-f386606bfa30 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.083751 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-43d9832f-d69a-4cff-86d1-8f68d1031236 req-093a2917-f840-415f-8408-b806958625a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049769 Aug 24 12:33:32.085369 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcd0df81-71bb-470a-8ee4-f386606bfa30 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.087393 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcd0df81-71bb-470a-8ee4-f386606bfa30 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.089033 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcd0df81-71bb-470a-8ee4-f386606bfa30 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.089400 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 75/143] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:32.091901 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcd0df81-71bb-470a-8ee4-f386606bfa30 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.093390 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcd0df81-71bb-470a-8ee4-f386606bfa30 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.239359 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-bcd0df81-71bb-470a-8ee4-f386606bfa30 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:32.249983 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-bcd0df81-71bb-470a-8ee4-f386606bfa30 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1515 microversion: 2.1 time: 0.201594 Aug 24 12:33:32.250965 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 69/144] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:32 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:32.274438 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-bc7484fc-4353-48cc-9df1-21e5f8cd012f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:32.276843 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-bc7484fc-4353-48cc-9df1-21e5f8cd012f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:32.283991 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bc7484fc-4353-48cc-9df1-21e5f8cd012f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.284714 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bc7484fc-4353-48cc-9df1-21e5f8cd012f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.285832 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bc7484fc-4353-48cc-9df1-21e5f8cd012f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.286997 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bc7484fc-4353-48cc-9df1-21e5f8cd012f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.287660 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bc7484fc-4353-48cc-9df1-21e5f8cd012f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.288241 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bc7484fc-4353-48cc-9df1-21e5f8cd012f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.326070 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-bc7484fc-4353-48cc-9df1-21e5f8cd012f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lazy-loading 'flavor' on Instance uuid d8467a7d-419f-4ec3-a8c5-d513d1ef2149 {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:33:32.553468 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-bc7484fc-4353-48cc-9df1-21e5f8cd012f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "POST /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149/action" status: 200 len: 32 microversion: 2.1 time: 0.283091 Aug 24 12:33:32.564700 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6039e647-5e3a-4883-93ea-92afc06dd3a1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:32.564959 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-6039e647-5e3a-4883-93ea-92afc06dd3a1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:32.569972 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 76/145] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 12:33:32 2022] POST /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149/action => generated 32 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:33:32.571611 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6039e647-5e3a-4883-93ea-92afc06dd3a1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.573258 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6039e647-5e3a-4883-93ea-92afc06dd3a1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.573873 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6039e647-5e3a-4883-93ea-92afc06dd3a1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.574919 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6039e647-5e3a-4883-93ea-92afc06dd3a1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.575514 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6039e647-5e3a-4883-93ea-92afc06dd3a1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.576219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6039e647-5e3a-4883-93ea-92afc06dd3a1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.740064 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6039e647-5e3a-4883-93ea-92afc06dd3a1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:32.748178 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-6039e647-5e3a-4883-93ea-92afc06dd3a1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.188224 Aug 24 12:33:32.749871 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 70/146] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:32 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:33.771331 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-02d3d73a-5fcf-4b22-8c2f-f4a17bf3d87c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:33.772419 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-02d3d73a-5fcf-4b22-8c2f-f4a17bf3d87c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:33.779099 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-02d3d73a-5fcf-4b22-8c2f-f4a17bf3d87c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:33.779604 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-02d3d73a-5fcf-4b22-8c2f-f4a17bf3d87c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:33.780582 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-02d3d73a-5fcf-4b22-8c2f-f4a17bf3d87c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:33.781294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-02d3d73a-5fcf-4b22-8c2f-f4a17bf3d87c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:33.781743 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-02d3d73a-5fcf-4b22-8c2f-f4a17bf3d87c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:33.782168 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-02d3d73a-5fcf-4b22-8c2f-f4a17bf3d87c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:33.927829 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-02d3d73a-5fcf-4b22-8c2f-f4a17bf3d87c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:33.936801 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-02d3d73a-5fcf-4b22-8c2f-f4a17bf3d87c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.170310 Aug 24 12:33:33.937648 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 77/147] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:33 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:34.959722 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-989a91f3-0dce-4e99-af6c-1515a450434d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:34.960422 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-989a91f3-0dce-4e99-af6c-1515a450434d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:34.985077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-989a91f3-0dce-4e99-af6c-1515a450434d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:34.985578 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-989a91f3-0dce-4e99-af6c-1515a450434d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:34.986021 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-989a91f3-0dce-4e99-af6c-1515a450434d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:34.986729 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-989a91f3-0dce-4e99-af6c-1515a450434d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:34.987191 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-989a91f3-0dce-4e99-af6c-1515a450434d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:34.987641 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-989a91f3-0dce-4e99-af6c-1515a450434d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:35.402083 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c0738fdf-0321-4fc6-95e1-e943200d0093 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:35.402587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c0738fdf-0321-4fc6-95e1-e943200d0093 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:35.412044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c0738fdf-0321-4fc6-95e1-e943200d0093 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:35.412537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c0738fdf-0321-4fc6-95e1-e943200d0093 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:35.413867 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c0738fdf-0321-4fc6-95e1-e943200d0093 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:35.414584 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c0738fdf-0321-4fc6-95e1-e943200d0093 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:35.415037 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c0738fdf-0321-4fc6-95e1-e943200d0093 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:35.415459 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c0738fdf-0321-4fc6-95e1-e943200d0093 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:35.435785 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-989a91f3-0dce-4e99-af6c-1515a450434d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:35.443883 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-989a91f3-0dce-4e99-af6c-1515a450434d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.489413 Aug 24 12:33:35.447827 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 71/148] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:34 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:35.466882 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c0738fdf-0321-4fc6-95e1-e943200d0093 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Going to try to terminate instance {{(pid=127308) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:33:35.473001 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:35.595556 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=100 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:35.625497 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c0738fdf-0321-4fc6-95e1-e943200d0093 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "DELETE /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 204 len: 0 microversion: 2.1 time: 0.230084 Aug 24 12:33:35.626084 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 78/149] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:33:35 2022] DELETE /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:33:35.637832 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-40f174fb-3d37-468c-b359-006ea6860c13 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:35.638722 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-40f174fb-3d37-468c-b359-006ea6860c13 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:35.645429 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-40f174fb-3d37-468c-b359-006ea6860c13 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:35.646069 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-40f174fb-3d37-468c-b359-006ea6860c13 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:35.646585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-40f174fb-3d37-468c-b359-006ea6860c13 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:35.647431 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-40f174fb-3d37-468c-b359-006ea6860c13 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:35.648707 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-40f174fb-3d37-468c-b359-006ea6860c13 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:35.649231 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-40f174fb-3d37-468c-b359-006ea6860c13 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:35.985505 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-40f174fb-3d37-468c-b359-006ea6860c13 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:35.994417 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-40f174fb-3d37-468c-b359-006ea6860c13 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1553 microversion: 2.1 time: 0.360737 Aug 24 12:33:35.994995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 72/150] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:35 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1553 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:36.469329 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4e0162f4-fd7a-4cd2-910e-bc8ecf258005 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:36.470184 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4e0162f4-fd7a-4cd2-910e-bc8ecf258005 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:36.476098 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e0162f4-fd7a-4cd2-910e-bc8ecf258005 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:36.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e0162f4-fd7a-4cd2-910e-bc8ecf258005 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:36.476993 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e0162f4-fd7a-4cd2-910e-bc8ecf258005 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:36.477674 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e0162f4-fd7a-4cd2-910e-bc8ecf258005 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:36.478116 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e0162f4-fd7a-4cd2-910e-bc8ecf258005 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:36.478524 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e0162f4-fd7a-4cd2-910e-bc8ecf258005 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:36.617432 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4e0162f4-fd7a-4cd2-910e-bc8ecf258005 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:36.632018 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4e0162f4-fd7a-4cd2-910e-bc8ecf258005 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.166913 Aug 24 12:33:36.632608 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 79/151] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:36 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:37.021331 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-577a83a0-b428-49c3-82ca-392112ce1606 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:37.022744 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-577a83a0-b428-49c3-82ca-392112ce1606 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:37.037679 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-577a83a0-b428-49c3-82ca-392112ce1606 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:37.038319 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-577a83a0-b428-49c3-82ca-392112ce1606 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:37.039591 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-577a83a0-b428-49c3-82ca-392112ce1606 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:37.040559 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-577a83a0-b428-49c3-82ca-392112ce1606 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:37.041193 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-577a83a0-b428-49c3-82ca-392112ce1606 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:37.041756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-577a83a0-b428-49c3-82ca-392112ce1606 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:37.188987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-577a83a0-b428-49c3-82ca-392112ce1606 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:37.197178 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-577a83a0-b428-49c3-82ca-392112ce1606 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1553 microversion: 2.1 time: 0.183132 Aug 24 12:33:37.197733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 73/152] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:37 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:37.653092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-05a8d102-4bba-4689-a0c3-b7eab95a89d9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:37.653690 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-05a8d102-4bba-4689-a0c3-b7eab95a89d9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:37.661364 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-05a8d102-4bba-4689-a0c3-b7eab95a89d9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:37.662033 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-05a8d102-4bba-4689-a0c3-b7eab95a89d9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:37.662624 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-05a8d102-4bba-4689-a0c3-b7eab95a89d9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:37.664213 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-05a8d102-4bba-4689-a0c3-b7eab95a89d9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:37.665068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-05a8d102-4bba-4689-a0c3-b7eab95a89d9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:37.665489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-05a8d102-4bba-4689-a0c3-b7eab95a89d9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:37.810660 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-05a8d102-4bba-4689-a0c3-b7eab95a89d9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:37.818757 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-05a8d102-4bba-4689-a0c3-b7eab95a89d9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.169573 Aug 24 12:33:37.819315 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 80/153] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:37 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:38.221780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5408208c-265d-4672-98e0-182819538e2e tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:38.223236 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5408208c-265d-4672-98e0-182819538e2e tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:38.235168 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5408208c-265d-4672-98e0-182819538e2e tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:38.236003 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5408208c-265d-4672-98e0-182819538e2e tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:38.245671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5408208c-265d-4672-98e0-182819538e2e tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:38.246711 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5408208c-265d-4672-98e0-182819538e2e tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:38.247416 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5408208c-265d-4672-98e0-182819538e2e tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:38.248314 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5408208c-265d-4672-98e0-182819538e2e tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:38.408742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5408208c-265d-4672-98e0-182819538e2e tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:38.419357 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5408208c-265d-4672-98e0-182819538e2e tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1553 microversion: 2.1 time: 0.202820 Aug 24 12:33:38.420172 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 74/154] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:38 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:38.844697 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1f197661-3459-47cf-859a-b56c2c7af70d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:38.845920 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1f197661-3459-47cf-859a-b56c2c7af70d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:38.853000 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1f197661-3459-47cf-859a-b56c2c7af70d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:38.853536 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1f197661-3459-47cf-859a-b56c2c7af70d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:38.854122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1f197661-3459-47cf-859a-b56c2c7af70d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:38.854880 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1f197661-3459-47cf-859a-b56c2c7af70d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:38.855330 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1f197661-3459-47cf-859a-b56c2c7af70d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:38.855790 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1f197661-3459-47cf-859a-b56c2c7af70d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:39.009121 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1f197661-3459-47cf-859a-b56c2c7af70d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:39.019075 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1f197661-3459-47cf-859a-b56c2c7af70d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.180371 Aug 24 12:33:39.020072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 81/155] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:38 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:39.237480 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-059df26c-0c29-4f9d-9c5f-40e138d595d6 req-be5a9db9-df15-478b-ab7c-8bd29e9459b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46eaa161-78d7-4c8a-9fe7-f1accd97238a", "name": "network-vif-deleted", "tag": "6e8bd6e8-d063-4381-b0f9-4b7b031b124e"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:39.251109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-059df26c-0c29-4f9d-9c5f-40e138d595d6 req-be5a9db9-df15-478b-ab7c-8bd29e9459b2 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:39.252007 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-059df26c-0c29-4f9d-9c5f-40e138d595d6 req-be5a9db9-df15-478b-ab7c-8bd29e9459b2 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:39.252632 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-059df26c-0c29-4f9d-9c5f-40e138d595d6 req-be5a9db9-df15-478b-ab7c-8bd29e9459b2 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:39.266633 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-059df26c-0c29-4f9d-9c5f-40e138d595d6 req-be5a9db9-df15-478b-ab7c-8bd29e9459b2 service nova] Creating event network-vif-deleted:6e8bd6e8-d063-4381-b0f9-4b7b031b124e for instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a on hv-cinder-84890 Aug 24 12:33:39.272977 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-059df26c-0c29-4f9d-9c5f-40e138d595d6 req-be5a9db9-df15-478b-ab7c-8bd29e9459b2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039878 Aug 24 12:33:39.278602 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 75/156] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:39.443988 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-97c9f36b-16d5-4333-9bda-0616aeef6129 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:39.444832 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-97c9f36b-16d5-4333-9bda-0616aeef6129 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:39.453292 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-97c9f36b-16d5-4333-9bda-0616aeef6129 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:39.453909 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-97c9f36b-16d5-4333-9bda-0616aeef6129 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:39.454505 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-97c9f36b-16d5-4333-9bda-0616aeef6129 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:39.455423 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-97c9f36b-16d5-4333-9bda-0616aeef6129 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:39.456019 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-97c9f36b-16d5-4333-9bda-0616aeef6129 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:39.456667 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-97c9f36b-16d5-4333-9bda-0616aeef6129 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:39.535858 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-97c9f36b-16d5-4333-9bda-0616aeef6129 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:39.547327 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-97c9f36b-16d5-4333-9bda-0616aeef6129 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1345 microversion: 2.1 time: 0.108567 Aug 24 12:33:39.551829 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 82/157] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:39 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:40.041823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2efd3608-6e01-48fc-8f26-5c4959f08abf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:40.042692 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2efd3608-6e01-48fc-8f26-5c4959f08abf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:40.049332 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2efd3608-6e01-48fc-8f26-5c4959f08abf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:40.049886 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2efd3608-6e01-48fc-8f26-5c4959f08abf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:40.050781 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2efd3608-6e01-48fc-8f26-5c4959f08abf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:40.051007 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2efd3608-6e01-48fc-8f26-5c4959f08abf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:40.051456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2efd3608-6e01-48fc-8f26-5c4959f08abf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:40.051901 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2efd3608-6e01-48fc-8f26-5c4959f08abf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:40.208076 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2efd3608-6e01-48fc-8f26-5c4959f08abf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:40.215674 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2efd3608-6e01-48fc-8f26-5c4959f08abf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.178055 Aug 24 12:33:40.216231 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 76/158] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:40 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:40.578170 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-13215871-b114-4573-b116-763198879338 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:40.578774 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-13215871-b114-4573-b116-763198879338 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:40.584743 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-13215871-b114-4573-b116-763198879338 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:40.585217 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-13215871-b114-4573-b116-763198879338 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:40.585644 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-13215871-b114-4573-b116-763198879338 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:40.586317 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-13215871-b114-4573-b116-763198879338 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:40.586758 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-13215871-b114-4573-b116-763198879338 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:40.587170 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-13215871-b114-4573-b116-763198879338 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:40.618859 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-13215871-b114-4573-b116-763198879338 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:40.619326 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-13215871-b114-4573-b116-763198879338 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:40.619793 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-13215871-b114-4573-b116-763198879338 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:40.620249 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-13215871-b114-4573-b116-763198879338 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lazy-loading 'fault' on Instance uuid 46eaa161-78d7-4c8a-9fe7-f1accd97238a {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:33:40.663520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-13215871-b114-4573-b116-763198879338 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:40.671633 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-13215871-b114-4573-b116-763198879338 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1350 microversion: 2.1 time: 0.098209 Aug 24 12:33:40.672203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 83/159] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:40 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:41.237245 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5e56d20a-201e-4851-920a-151cd27e2c80 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:41.237861 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5e56d20a-201e-4851-920a-151cd27e2c80 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:41.244567 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5e56d20a-201e-4851-920a-151cd27e2c80 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:41.245055 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5e56d20a-201e-4851-920a-151cd27e2c80 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:41.245492 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5e56d20a-201e-4851-920a-151cd27e2c80 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:41.246186 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5e56d20a-201e-4851-920a-151cd27e2c80 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:41.246640 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5e56d20a-201e-4851-920a-151cd27e2c80 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:41.247065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5e56d20a-201e-4851-920a-151cd27e2c80 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:41.252446 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:41.378343 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5e56d20a-201e-4851-920a-151cd27e2c80 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:41.385951 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5e56d20a-201e-4851-920a-151cd27e2c80 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.153226 Aug 24 12:33:41.386508 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 77/160] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:41 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:41.696570 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f9227fa5-8dd8-4838-9175-4ef5c040e785 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:41.697116 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f9227fa5-8dd8-4838-9175-4ef5c040e785 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:41.704141 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f9227fa5-8dd8-4838-9175-4ef5c040e785 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:41.704622 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f9227fa5-8dd8-4838-9175-4ef5c040e785 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:41.705054 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f9227fa5-8dd8-4838-9175-4ef5c040e785 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:41.705737 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f9227fa5-8dd8-4838-9175-4ef5c040e785 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:41.706187 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f9227fa5-8dd8-4838-9175-4ef5c040e785 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:41.706602 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f9227fa5-8dd8-4838-9175-4ef5c040e785 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:41.737719 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f9227fa5-8dd8-4838-9175-4ef5c040e785 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:41.738197 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f9227fa5-8dd8-4838-9175-4ef5c040e785 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:41.738625 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f9227fa5-8dd8-4838-9175-4ef5c040e785 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:41.739068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-f9227fa5-8dd8-4838-9175-4ef5c040e785 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lazy-loading 'fault' on Instance uuid 46eaa161-78d7-4c8a-9fe7-f1accd97238a {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:33:41.781857 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f9227fa5-8dd8-4838-9175-4ef5c040e785 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539573490e0d4e128caf93c51567ed79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd2c804427749c68ff038d019a1628b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:41.789857 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f9227fa5-8dd8-4838-9175-4ef5c040e785 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 200 len: 1350 microversion: 2.1 time: 0.097175 Aug 24 12:33:41.790418 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 84/161] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:41 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:42.406316 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3e81b5ba-447a-4edc-85de-ab4d015b0841 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:42.407304 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3e81b5ba-447a-4edc-85de-ab4d015b0841 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:42.413774 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3e81b5ba-447a-4edc-85de-ab4d015b0841 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:42.414261 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3e81b5ba-447a-4edc-85de-ab4d015b0841 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:42.414725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3e81b5ba-447a-4edc-85de-ab4d015b0841 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:42.415419 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3e81b5ba-447a-4edc-85de-ab4d015b0841 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:42.415902 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3e81b5ba-447a-4edc-85de-ab4d015b0841 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:42.416330 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3e81b5ba-447a-4edc-85de-ab4d015b0841 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:42.544808 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-3e81b5ba-447a-4edc-85de-ab4d015b0841 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:42.553057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3e81b5ba-447a-4edc-85de-ab4d015b0841 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.150596 Aug 24 12:33:42.553628 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 78/162] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:42 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:42.810414 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-16b12b53-ecc1-40d0-b01a-53fc55594522 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:42.811016 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-16b12b53-ecc1-40d0-b01a-53fc55594522 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:42.817726 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-16b12b53-ecc1-40d0-b01a-53fc55594522 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:42.818205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-16b12b53-ecc1-40d0-b01a-53fc55594522 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:42.818634 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-16b12b53-ecc1-40d0-b01a-53fc55594522 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:42.819313 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-16b12b53-ecc1-40d0-b01a-53fc55594522 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:42.819794 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-16b12b53-ecc1-40d0-b01a-53fc55594522 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:42.820212 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-16b12b53-ecc1-40d0-b01a-53fc55594522 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:42.834402 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-16b12b53-ecc1-40d0-b01a-53fc55594522 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] HTTP exception thrown: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-16b12b53-ecc1-40d0-b01a-53fc55594522 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Request method failure captured: Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a HTTP/1.1 Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhplghFJhmKFn9K5ccKSqFiQMXoWMRZccB_Bs2I_bxyh0KryTnaU-2a34VpQK0_PbpgMTCR9YFcpBPXXbhsmKD2muv2Y_oelWj1CRjB3_gczBIlqCqzAOCD1OnAsteqlSMX-Y6mtdq4EzYQljRznwaTxqybsTNdNhcpyhHA944JsqrY Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 2fd2c804427749c68ff038d019a1628b Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-DeleteServersTestJSON-1578396851 Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:33:42.838968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:33:42.840574 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd2c804427749c68ff038d019a1628b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd2c804427749c68ff038d019a1628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2fd2c804427749c68ff038d019a1628b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2fd2c804427749c68ff038d019a1628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:33:42.840574 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-DeleteServersTestJSON-1578396851 Aug 24 12:33:42.840574 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 2fd2c804427749c68ff038d019a1628b Aug 24 12:33:42.840574 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-DeleteServersTestJSON-1578396851 Aug 24 12:33:42.840574 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-DeleteServersTestJSON-1578396851-project Aug 24 12:33:42.840574 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:33:42.840574 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:33:42.840574 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 539573490e0d4e128caf93c51567ed79 Aug 24 12:33:42.840574 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-DeleteServersTestJSON-1578396851-project Aug 24 12:33:42.840574 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:33:42.840574 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:42.840574 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '46eaa161-78d7-4c8a-9fe7-f1accd97238a'} Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:33:42.841473 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:42.842877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:33:42.844223 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-16b12b53-ecc1-40d0-b01a-53fc55594522 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Returning 404 to user: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:33:42.844223 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-16b12b53-ecc1-40d0-b01a-53fc55594522 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 404 len: 111 microversion: 2.1 time: 0.033904 Aug 24 12:33:42.844223 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 85/163] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:42 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:33:42.950408 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a20397bf-dc22-46a0-a4dc-745c6995a5c4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:42.952816 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a20397bf-dc22-46a0-a4dc-745c6995a5c4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:42.958598 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a20397bf-dc22-46a0-a4dc-745c6995a5c4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:42.959075 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a20397bf-dc22-46a0-a4dc-745c6995a5c4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:42.959514 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a20397bf-dc22-46a0-a4dc-745c6995a5c4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:42.960230 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a20397bf-dc22-46a0-a4dc-745c6995a5c4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:42.960702 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a20397bf-dc22-46a0-a4dc-745c6995a5c4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:42.961126 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a20397bf-dc22-46a0-a4dc-745c6995a5c4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:42.973453 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-a20397bf-dc22-46a0-a4dc-745c6995a5c4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] HTTP exception thrown: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a20397bf-dc22-46a0-a4dc-745c6995a5c4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Request method failure captured: Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a/os-volume_attachments HTTP/1.1 Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhplghFJhmKFn9K5ccKSqFiQMXoWMRZccB_Bs2I_bxyh0KryTnaU-2a34VpQK0_PbpgMTCR9YFcpBPXXbhsmKD2muv2Y_oelWj1CRjB3_gczBIlqCqzAOCD1OnAsteqlSMX-Y6mtdq4EzYQljRznwaTxqybsTNdNhcpyhHA944JsqrY Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: 2fd2c804427749c68ff038d019a1628b Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-DeleteServersTestJSON-1578396851 Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:33:42.978362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:33:42.979809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd2c804427749c68ff038d019a1628b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd2c804427749c68ff038d019a1628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2fd2c804427749c68ff038d019a1628b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2fd2c804427749c68ff038d019a1628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:33:42.979809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-DeleteServersTestJSON-1578396851 Aug 24 12:33:42.979809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: 2fd2c804427749c68ff038d019a1628b Aug 24 12:33:42.979809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-DeleteServersTestJSON-1578396851 Aug 24 12:33:42.979809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-DeleteServersTestJSON-1578396851-project Aug 24 12:33:42.979809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:33:42.979809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:33:42.979809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 539573490e0d4e128caf93c51567ed79 Aug 24 12:33:42.979809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-DeleteServersTestJSON-1578396851-project Aug 24 12:33:42.979809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:33:42.979809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:42.979809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'server_id': '46eaa161-78d7-4c8a-9fe7-f1accd97238a'} Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:33:42.980708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:42.982089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:33:42.983594 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a20397bf-dc22-46a0-a4dc-745c6995a5c4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Returning 404 to user: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:33:42.983594 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a20397bf-dc22-46a0-a4dc-745c6995a5c4 tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033240 Aug 24 12:33:42.983594 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 79/164] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:33:42 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:33:43.574339 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9eb7bb67-aa7f-4693-bcbc-bda5af39795f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:43.574951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9eb7bb67-aa7f-4693-bcbc-bda5af39795f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:43.582004 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9eb7bb67-aa7f-4693-bcbc-bda5af39795f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:43.582878 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9eb7bb67-aa7f-4693-bcbc-bda5af39795f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:43.583343 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9eb7bb67-aa7f-4693-bcbc-bda5af39795f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:43.584633 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9eb7bb67-aa7f-4693-bcbc-bda5af39795f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:43.585420 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9eb7bb67-aa7f-4693-bcbc-bda5af39795f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:43.585966 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9eb7bb67-aa7f-4693-bcbc-bda5af39795f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:43.750309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9eb7bb67-aa7f-4693-bcbc-bda5af39795f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:43.759532 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9eb7bb67-aa7f-4693-bcbc-bda5af39795f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.189060 Aug 24 12:33:43.760318 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 86/165] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:43 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:44.781240 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-614bff43-d91e-404d-bc4d-4697879b7876 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:44.781858 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-614bff43-d91e-404d-bc4d-4697879b7876 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:44.794261 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-614bff43-d91e-404d-bc4d-4697879b7876 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:44.794776 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-614bff43-d91e-404d-bc4d-4697879b7876 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:44.795536 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-614bff43-d91e-404d-bc4d-4697879b7876 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:44.797524 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-614bff43-d91e-404d-bc4d-4697879b7876 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:44.798560 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-614bff43-d91e-404d-bc4d-4697879b7876 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:44.799206 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-614bff43-d91e-404d-bc4d-4697879b7876 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:44.971045 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-614bff43-d91e-404d-bc4d-4697879b7876 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:44.978824 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-614bff43-d91e-404d-bc4d-4697879b7876 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.201482 Aug 24 12:33:44.979993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 80/166] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:44 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:45.248622 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-3094259a-a196-44d0-8880-0684abd3c93b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:45.249316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-3094259a-a196-44d0-8880-0684abd3c93b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:45.255997 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3094259a-a196-44d0-8880-0684abd3c93b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:45.256623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3094259a-a196-44d0-8880-0684abd3c93b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:45.256997 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3094259a-a196-44d0-8880-0684abd3c93b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:45.258081 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3094259a-a196-44d0-8880-0684abd3c93b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:45.258628 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3094259a-a196-44d0-8880-0684abd3c93b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:45.259123 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3094259a-a196-44d0-8880-0684abd3c93b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:45.273876 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-3094259a-a196-44d0-8880-0684abd3c93b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] HTTP exception thrown: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-3094259a-a196-44d0-8880-0684abd3c93b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Request method failure captured: Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: DELETE /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a HTTP/1.1 Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhplghFJhmKFn9K5ccKSqFiQMXoWMRZccB_Bs2I_bxyh0KryTnaU-2a34VpQK0_PbpgMTCR9YFcpBPXXbhsmKD2muv2Y_oelWj1CRjB3_gczBIlqCqzAOCD1OnAsteqlSMX-Y6mtdq4EzYQljRznwaTxqybsTNdNhcpyhHA944JsqrY Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 2fd2c804427749c68ff038d019a1628b Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-DeleteServersTestJSON-1578396851 Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:33:45.275862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:33:45.277721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd2c804427749c68ff038d019a1628b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd2c804427749c68ff038d019a1628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2fd2c804427749c68ff038d019a1628b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2fd2c804427749c68ff038d019a1628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:33:45.277721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-DeleteServersTestJSON-1578396851 Aug 24 12:33:45.277721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 2fd2c804427749c68ff038d019a1628b Aug 24 12:33:45.277721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-DeleteServersTestJSON-1578396851 Aug 24 12:33:45.277721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-DeleteServersTestJSON-1578396851-project Aug 24 12:33:45.277721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:33:45.277721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:33:45.277721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 539573490e0d4e128caf93c51567ed79 Aug 24 12:33:45.277721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-DeleteServersTestJSON-1578396851-project Aug 24 12:33:45.277721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:33:45.277721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:45.277721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '46eaa161-78d7-4c8a-9fe7-f1accd97238a'} Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:33:45.280442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:45.285728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:33:45.287014 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-3094259a-a196-44d0-8880-0684abd3c93b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Returning 404 to user: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:33:45.287014 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-3094259a-a196-44d0-8880-0684abd3c93b tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "DELETE /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 404 len: 111 microversion: 2.1 time: 0.032503 Aug 24 12:33:45.287014 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 87/167] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:33:45 2022] DELETE /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 12:33:45.287282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-61057320-c560-4ad1-a574-05a523da10da tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:45.287282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-61057320-c560-4ad1-a574-05a523da10da tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] [instance: 46eaa161-78d7-4c8a-9fe7-f1accd97238a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:45.293504 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-61057320-c560-4ad1-a574-05a523da10da tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:45.293981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-61057320-c560-4ad1-a574-05a523da10da tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:45.294418 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-61057320-c560-4ad1-a574-05a523da10da tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:45.295104 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-61057320-c560-4ad1-a574-05a523da10da tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:45.295554 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-61057320-c560-4ad1-a574-05a523da10da tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:45.296046 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-61057320-c560-4ad1-a574-05a523da10da tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:45.310301 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-61057320-c560-4ad1-a574-05a523da10da tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] HTTP exception thrown: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-61057320-c560-4ad1-a574-05a523da10da tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Request method failure captured: Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a HTTP/1.1 Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhplghFJhmKFn9K5ccKSqFiQMXoWMRZccB_Bs2I_bxyh0KryTnaU-2a34VpQK0_PbpgMTCR9YFcpBPXXbhsmKD2muv2Y_oelWj1CRjB3_gczBIlqCqzAOCD1OnAsteqlSMX-Y6mtdq4EzYQljRznwaTxqybsTNdNhcpyhHA944JsqrY Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: 2fd2c804427749c68ff038d019a1628b Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-DeleteServersTestJSON-1578396851 Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:33:45.312869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:33:45.314109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd2c804427749c68ff038d019a1628b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd2c804427749c68ff038d019a1628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2fd2c804427749c68ff038d019a1628b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2fd2c804427749c68ff038d019a1628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:33:45.314109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-DeleteServersTestJSON-1578396851 Aug 24 12:33:45.314109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: 2fd2c804427749c68ff038d019a1628b Aug 24 12:33:45.314109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-DeleteServersTestJSON-1578396851 Aug 24 12:33:45.314109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-DeleteServersTestJSON-1578396851-project Aug 24 12:33:45.314109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:33:45.314109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:33:45.314109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 539573490e0d4e128caf93c51567ed79 Aug 24 12:33:45.314109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-DeleteServersTestJSON-1578396851-project Aug 24 12:33:45.314109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:33:45.314109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:45.314109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': '46eaa161-78d7-4c8a-9fe7-f1accd97238a'} Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:33:45.314767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. Aug 24 12:33:45.316197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:33:45.317227 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-61057320-c560-4ad1-a574-05a523da10da tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] Returning 404 to user: Instance 46eaa161-78d7-4c8a-9fe7-f1accd97238a could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:33:45.317227 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-61057320-c560-4ad1-a574-05a523da10da tempest-DeleteServersTestJSON-1578396851 tempest-DeleteServersTestJSON-1578396851-project] 10.222.0.58 "GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a" status: 404 len: 111 microversion: 2.1 time: 0.031525 Aug 24 12:33:45.317227 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 81/168] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:45 2022] GET /compute/v2.1/servers/46eaa161-78d7-4c8a-9fe7-f1accd97238a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:33:46.001896 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-3bbece5d-94e8-4b59-8222-9b2bf8a80986 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:46.002504 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-3bbece5d-94e8-4b59-8222-9b2bf8a80986 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:46.009308 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bbece5d-94e8-4b59-8222-9b2bf8a80986 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:46.009844 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bbece5d-94e8-4b59-8222-9b2bf8a80986 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:46.010436 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bbece5d-94e8-4b59-8222-9b2bf8a80986 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:46.011274 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bbece5d-94e8-4b59-8222-9b2bf8a80986 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:46.011740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bbece5d-94e8-4b59-8222-9b2bf8a80986 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:46.012338 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bbece5d-94e8-4b59-8222-9b2bf8a80986 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:46.160282 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-3bbece5d-94e8-4b59-8222-9b2bf8a80986 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:46.167935 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-3bbece5d-94e8-4b59-8222-9b2bf8a80986 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.170553 Aug 24 12:33:46.168498 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 88/169] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:45 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:47.190204 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c07f3e43-b324-44d1-9a79-9d1d8455ed9a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:47.194629 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c07f3e43-b324-44d1-9a79-9d1d8455ed9a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:47.205963 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c07f3e43-b324-44d1-9a79-9d1d8455ed9a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:47.206883 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c07f3e43-b324-44d1-9a79-9d1d8455ed9a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:47.208060 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c07f3e43-b324-44d1-9a79-9d1d8455ed9a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:47.210449 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c07f3e43-b324-44d1-9a79-9d1d8455ed9a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:47.211537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c07f3e43-b324-44d1-9a79-9d1d8455ed9a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:47.212419 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c07f3e43-b324-44d1-9a79-9d1d8455ed9a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:47.497638 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c07f3e43-b324-44d1-9a79-9d1d8455ed9a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:47.507602 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c07f3e43-b324-44d1-9a79-9d1d8455ed9a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.322482 Aug 24 12:33:47.508790 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 82/170] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:47 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:48.531590 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1ad1a3f3-c746-47cb-a594-3d153f201816 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:48.531590 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1ad1a3f3-c746-47cb-a594-3d153f201816 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:48.538257 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1ad1a3f3-c746-47cb-a594-3d153f201816 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:48.538849 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1ad1a3f3-c746-47cb-a594-3d153f201816 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:48.539429 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1ad1a3f3-c746-47cb-a594-3d153f201816 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:48.540214 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1ad1a3f3-c746-47cb-a594-3d153f201816 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:48.540760 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1ad1a3f3-c746-47cb-a594-3d153f201816 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:48.541364 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1ad1a3f3-c746-47cb-a594-3d153f201816 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:48.790445 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1ad1a3f3-c746-47cb-a594-3d153f201816 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:48.798893 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1ad1a3f3-c746-47cb-a594-3d153f201816 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.273885 Aug 24 12:33:48.799723 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 89/171] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:48 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:49.820106 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8edc901d-45b8-4a01-a86f-9e26c0af0ed6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:49.821352 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8edc901d-45b8-4a01-a86f-9e26c0af0ed6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:49.831509 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8edc901d-45b8-4a01-a86f-9e26c0af0ed6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:49.832245 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8edc901d-45b8-4a01-a86f-9e26c0af0ed6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:49.832701 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8edc901d-45b8-4a01-a86f-9e26c0af0ed6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:49.833381 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8edc901d-45b8-4a01-a86f-9e26c0af0ed6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:49.833882 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8edc901d-45b8-4a01-a86f-9e26c0af0ed6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:49.834365 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8edc901d-45b8-4a01-a86f-9e26c0af0ed6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:50.038701 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8edc901d-45b8-4a01-a86f-9e26c0af0ed6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:50.046823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8edc901d-45b8-4a01-a86f-9e26c0af0ed6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.229930 Aug 24 12:33:50.047574 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 83/172] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:49 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:51.073422 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-5ac27ed9-f8dd-4be8-8015-4d4608bcae4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:51.074122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-5ac27ed9-f8dd-4be8-8015-4d4608bcae4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:51.086436 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5ac27ed9-f8dd-4be8-8015-4d4608bcae4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:51.086943 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5ac27ed9-f8dd-4be8-8015-4d4608bcae4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:51.087379 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5ac27ed9-f8dd-4be8-8015-4d4608bcae4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:51.088121 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5ac27ed9-f8dd-4be8-8015-4d4608bcae4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:51.093080 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5ac27ed9-f8dd-4be8-8015-4d4608bcae4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:51.093838 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5ac27ed9-f8dd-4be8-8015-4d4608bcae4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:51.322375 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-5ac27ed9-f8dd-4be8-8015-4d4608bcae4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:51.332965 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-5ac27ed9-f8dd-4be8-8015-4d4608bcae4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.266048 Aug 24 12:33:51.333964 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 90/173] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:51 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:52.355586 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-7142f979-0353-47bd-99d5-722212e32e24 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:52.356214 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-7142f979-0353-47bd-99d5-722212e32e24 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:52.381309 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7142f979-0353-47bd-99d5-722212e32e24 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:52.381806 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7142f979-0353-47bd-99d5-722212e32e24 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:52.382239 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7142f979-0353-47bd-99d5-722212e32e24 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:52.382948 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7142f979-0353-47bd-99d5-722212e32e24 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:52.387540 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7142f979-0353-47bd-99d5-722212e32e24 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:52.388238 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7142f979-0353-47bd-99d5-722212e32e24 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:52.563680 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7142f979-0353-47bd-99d5-722212e32e24 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:52.573477 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-7142f979-0353-47bd-99d5-722212e32e24 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.222933 Aug 24 12:33:52.587541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 84/174] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:52 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:53.594879 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-6c20df3b-8725-4329-b6e1-33b0e95fe9e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:53.595470 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-6c20df3b-8725-4329-b6e1-33b0e95fe9e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:53.603780 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6c20df3b-8725-4329-b6e1-33b0e95fe9e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:53.605995 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6c20df3b-8725-4329-b6e1-33b0e95fe9e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:53.606609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6c20df3b-8725-4329-b6e1-33b0e95fe9e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:53.608425 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6c20df3b-8725-4329-b6e1-33b0e95fe9e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:53.610856 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6c20df3b-8725-4329-b6e1-33b0e95fe9e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:53.611475 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6c20df3b-8725-4329-b6e1-33b0e95fe9e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:53.777908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6c20df3b-8725-4329-b6e1-33b0e95fe9e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:53.787940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-6c20df3b-8725-4329-b6e1-33b0e95fe9e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.197398 Aug 24 12:33:53.789249 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 91/175] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:53 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:54.812589 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8b089973-7f8a-4682-ae63-4b56c46e1d4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:54.813293 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8b089973-7f8a-4682-ae63-4b56c46e1d4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:54.820756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8b089973-7f8a-4682-ae63-4b56c46e1d4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:54.821526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8b089973-7f8a-4682-ae63-4b56c46e1d4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:54.821973 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8b089973-7f8a-4682-ae63-4b56c46e1d4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:54.822676 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8b089973-7f8a-4682-ae63-4b56c46e1d4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:54.823131 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8b089973-7f8a-4682-ae63-4b56c46e1d4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:54.823549 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8b089973-7f8a-4682-ae63-4b56c46e1d4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:55.027050 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8b089973-7f8a-4682-ae63-4b56c46e1d4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:55.037384 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8b089973-7f8a-4682-ae63-4b56c46e1d4c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.229036 Aug 24 12:33:55.038209 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 85/176] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:54 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:56.058464 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-37571023-3ef0-4f4a-962e-b73145c6555c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:56.059072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-37571023-3ef0-4f4a-962e-b73145c6555c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:56.075556 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-37571023-3ef0-4f4a-962e-b73145c6555c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:56.083942 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-37571023-3ef0-4f4a-962e-b73145c6555c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:56.084389 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-37571023-3ef0-4f4a-962e-b73145c6555c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:56.085312 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-37571023-3ef0-4f4a-962e-b73145c6555c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:56.085924 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-37571023-3ef0-4f4a-962e-b73145c6555c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:56.086534 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-37571023-3ef0-4f4a-962e-b73145c6555c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:56.264404 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-37571023-3ef0-4f4a-962e-b73145c6555c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:56.278425 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-37571023-3ef0-4f4a-962e-b73145c6555c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.223612 Aug 24 12:33:56.292582 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 92/177] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:56 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:57.301869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-fe5c073a-a900-4e6f-a17d-b67cd10557af tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:57.302879 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-fe5c073a-a900-4e6f-a17d-b67cd10557af tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:57.309277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fe5c073a-a900-4e6f-a17d-b67cd10557af tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:57.309772 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fe5c073a-a900-4e6f-a17d-b67cd10557af tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:57.310207 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fe5c073a-a900-4e6f-a17d-b67cd10557af tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:57.311109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fe5c073a-a900-4e6f-a17d-b67cd10557af tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:57.312422 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fe5c073a-a900-4e6f-a17d-b67cd10557af tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:57.313083 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fe5c073a-a900-4e6f-a17d-b67cd10557af tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:57.463949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-fe5c073a-a900-4e6f-a17d-b67cd10557af tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:57.473789 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-fe5c073a-a900-4e6f-a17d-b67cd10557af tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.176405 Aug 24 12:33:57.475583 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 86/178] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:57 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:58.301886 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-24007893", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452"}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:58.355660 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.network.neutron [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] validate_networks() for None {{(pid=127308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:33:58.503143 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ff06d428-cd72-4ba4-b9e7-72bda6499dee tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:58.503929 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ff06d428-cd72-4ba4-b9e7-72bda6499dee tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:58.506232 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=47 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:58.511294 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ff06d428-cd72-4ba4-b9e7-72bda6499dee tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:58.511807 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ff06d428-cd72-4ba4-b9e7-72bda6499dee tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:58.512251 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ff06d428-cd72-4ba4-b9e7-72bda6499dee tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:58.512961 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ff06d428-cd72-4ba4-b9e7-72bda6499dee tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:58.513402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ff06d428-cd72-4ba4-b9e7-72bda6499dee tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:58.513860 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ff06d428-cd72-4ba4-b9e7-72bda6499dee tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:58.787516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Flavor limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:33:58.788427 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Image limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:33:58.789138 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Flavor pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:33:58.789968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Image pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:33:58.790199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ff06d428-cd72-4ba4-b9e7-72bda6499dee tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:58.790835 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:33:58.802657 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ff06d428-cd72-4ba4-b9e7-72bda6499dee tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.301504 Aug 24 12:33:58.804677 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:58.805445 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:58.806733 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:58.807927 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:58.808446 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:58.809055 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:58.809204 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 87/179] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:58 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:58.846034 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Getting quotas for project 2bdabfd06f064b05a6d8ec06b4fca329. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:33:58.851768 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Getting quotas for user 2af58e3ca6394bfa8ca34007c4ece01a and project 2bdabfd06f064b05a6d8ec06b4fca329. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:33:58.865127 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Going to run 1 instances... {{(pid=127308) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:33:58.867871 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:33:58.925636 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1206a286-f764-4b8e-8461-4d7acb5d8366 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627558 Aug 24 12:33:58.932218 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 93/180] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:33:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:33:58.937334 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-36610663-95f7-4bef-ab96-9545d6f7ee7d tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:58.937950 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-36610663-95f7-4bef-ab96-9545d6f7ee7d tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:59.021569 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-36610663-95f7-4bef-ab96-9545d6f7ee7d tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:59.029528 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-36610663-95f7-4bef-ab96-9545d6f7ee7d tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1213 microversion: 2.1 time: 0.095986 Aug 24 12:33:59.030101 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 88/181] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:58 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:59.832616 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-23f18506-5a45-415e-8b51-48adf8b52c01 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:59.833231 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-23f18506-5a45-415e-8b51-48adf8b52c01 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:59.839083 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-23f18506-5a45-415e-8b51-48adf8b52c01 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:59.839561 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-23f18506-5a45-415e-8b51-48adf8b52c01 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:59.840032 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-23f18506-5a45-415e-8b51-48adf8b52c01 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:59.840711 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-23f18506-5a45-415e-8b51-48adf8b52c01 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:59.841157 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-23f18506-5a45-415e-8b51-48adf8b52c01 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:59.841573 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-23f18506-5a45-415e-8b51-48adf8b52c01 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:59.984712 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-23f18506-5a45-415e-8b51-48adf8b52c01 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:59.993337 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-23f18506-5a45-415e-8b51-48adf8b52c01 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.164584 Aug 24 12:33:59.993916 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 94/182] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:59 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:00.050617 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0476d17c-136e-4c41-be4c-6e07c534ec49 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:00.051217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0476d17c-136e-4c41-be4c-6e07c534ec49 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:00.059055 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0476d17c-136e-4c41-be4c-6e07c534ec49 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:00.059559 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0476d17c-136e-4c41-be4c-6e07c534ec49 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:00.060029 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0476d17c-136e-4c41-be4c-6e07c534ec49 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:00.060738 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0476d17c-136e-4c41-be4c-6e07c534ec49 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:00.061192 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0476d17c-136e-4c41-be4c-6e07c534ec49 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:00.062461 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0476d17c-136e-4c41-be4c-6e07c534ec49 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:00.129404 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-0476d17c-136e-4c41-be4c-6e07c534ec49 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:00.138269 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0476d17c-136e-4c41-be4c-6e07c534ec49 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1273 microversion: 2.1 time: 0.091729 Aug 24 12:34:00.138852 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 89/183] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:00 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:01.016420 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-0cbddda5-3f70-44f1-bcf4-31839c382b83 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:01.017236 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-0cbddda5-3f70-44f1-bcf4-31839c382b83 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:01.025646 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0cbddda5-3f70-44f1-bcf4-31839c382b83 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:01.027153 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0cbddda5-3f70-44f1-bcf4-31839c382b83 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:01.028117 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0cbddda5-3f70-44f1-bcf4-31839c382b83 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:01.029926 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0cbddda5-3f70-44f1-bcf4-31839c382b83 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:01.030695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0cbddda5-3f70-44f1-bcf4-31839c382b83 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:01.032782 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0cbddda5-3f70-44f1-bcf4-31839c382b83 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:01.039442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:01.160378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e4973a14-986f-4f91-bf58-b3353296dd28 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:01.161131 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e4973a14-986f-4f91-bf58-b3353296dd28 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:01.167817 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e4973a14-986f-4f91-bf58-b3353296dd28 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:01.174507 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e4973a14-986f-4f91-bf58-b3353296dd28 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:01.175122 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e4973a14-986f-4f91-bf58-b3353296dd28 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:01.175898 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e4973a14-986f-4f91-bf58-b3353296dd28 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:01.176535 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e4973a14-986f-4f91-bf58-b3353296dd28 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:01.177111 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e4973a14-986f-4f91-bf58-b3353296dd28 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:01.534386 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e4973a14-986f-4f91-bf58-b3353296dd28 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:01.535848 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-0cbddda5-3f70-44f1-bcf4-31839c382b83 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:01.545565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-0cbddda5-3f70-44f1-bcf4-31839c382b83 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.534308 Aug 24 12:34:01.547929 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 95/184] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:01 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:01.553527 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e4973a14-986f-4f91-bf58-b3353296dd28 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1271 microversion: 2.1 time: 0.397534 Aug 24 12:34:01.554356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 90/185] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:01 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1271 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:02.568366 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-0673ed54-d7dc-4072-976f-577d47b62fcf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:02.568966 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-0673ed54-d7dc-4072-976f-577d47b62fcf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:02.574735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ad0d5585-9e7b-4ec5-935a-f33a39b718b9 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:02.575930 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ad0d5585-9e7b-4ec5-935a-f33a39b718b9 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:02.586068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0673ed54-d7dc-4072-976f-577d47b62fcf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:02.586565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0673ed54-d7dc-4072-976f-577d47b62fcf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:02.587122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0673ed54-d7dc-4072-976f-577d47b62fcf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:02.588159 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0673ed54-d7dc-4072-976f-577d47b62fcf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:02.588621 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0673ed54-d7dc-4072-976f-577d47b62fcf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:02.588835 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ad0d5585-9e7b-4ec5-935a-f33a39b718b9 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:02.589045 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0673ed54-d7dc-4072-976f-577d47b62fcf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:02.589327 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ad0d5585-9e7b-4ec5-935a-f33a39b718b9 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:02.589768 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ad0d5585-9e7b-4ec5-935a-f33a39b718b9 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:02.590471 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ad0d5585-9e7b-4ec5-935a-f33a39b718b9 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:02.590934 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ad0d5585-9e7b-4ec5-935a-f33a39b718b9 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:02.591369 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ad0d5585-9e7b-4ec5-935a-f33a39b718b9 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:02.948983 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ad0d5585-9e7b-4ec5-935a-f33a39b718b9 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:02.957476 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ad0d5585-9e7b-4ec5-935a-f33a39b718b9 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1313 microversion: 2.1 time: 0.386523 Aug 24 12:34:02.958667 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 91/186] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:02 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:02.968251 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-0673ed54-d7dc-4072-976f-577d47b62fcf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:02.977352 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-0673ed54-d7dc-4072-976f-577d47b62fcf tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.412937 Aug 24 12:34:02.978115 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 96/187] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:02 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:03.214492 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-95783c49-2769-4d10-943e-b9b1c2675f1b req-0e317e02-50bb-460e-bd47-dfb93ac86d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1797e36f-d4b3-4860-9d3c-079391c36fc4", "tag": "afc57e8e-c5f3-4c03-8de7-ee3d56057743"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:03.223887 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-95783c49-2769-4d10-943e-b9b1c2675f1b req-0e317e02-50bb-460e-bd47-dfb93ac86d99 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:03.224369 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-95783c49-2769-4d10-943e-b9b1c2675f1b req-0e317e02-50bb-460e-bd47-dfb93ac86d99 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:03.224800 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-95783c49-2769-4d10-943e-b9b1c2675f1b req-0e317e02-50bb-460e-bd47-dfb93ac86d99 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:03.236002 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-95783c49-2769-4d10-943e-b9b1c2675f1b req-0e317e02-50bb-460e-bd47-dfb93ac86d99 service nova] Creating event network-changed:afc57e8e-c5f3-4c03-8de7-ee3d56057743 for instance 1797e36f-d4b3-4860-9d3c-079391c36fc4 on hv-cinder-84890 Aug 24 12:34:03.240894 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-95783c49-2769-4d10-943e-b9b1c2675f1b req-0e317e02-50bb-460e-bd47-dfb93ac86d99 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030017 Aug 24 12:34:03.241642 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 92/188] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:03.983172 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a250e983-b05d-4cdc-82ad-34c60fbac09c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:03.984437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-a250e983-b05d-4cdc-82ad-34c60fbac09c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:03.991455 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a250e983-b05d-4cdc-82ad-34c60fbac09c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:03.992066 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a250e983-b05d-4cdc-82ad-34c60fbac09c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:03.992566 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a250e983-b05d-4cdc-82ad-34c60fbac09c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:03.993343 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a250e983-b05d-4cdc-82ad-34c60fbac09c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:04.000396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-830cbd82-8644-4d5a-9bd9-199b07480079 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:04.001652 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-830cbd82-8644-4d5a-9bd9-199b07480079 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:04.005046 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a250e983-b05d-4cdc-82ad-34c60fbac09c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:04.005765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a250e983-b05d-4cdc-82ad-34c60fbac09c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:04.023387 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-830cbd82-8644-4d5a-9bd9-199b07480079 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:04.023663 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-830cbd82-8644-4d5a-9bd9-199b07480079 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:04.024195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-830cbd82-8644-4d5a-9bd9-199b07480079 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:04.025016 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-830cbd82-8644-4d5a-9bd9-199b07480079 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:04.025760 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-830cbd82-8644-4d5a-9bd9-199b07480079 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:04.026680 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-830cbd82-8644-4d5a-9bd9-199b07480079 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:04.229713 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-a250e983-b05d-4cdc-82ad-34c60fbac09c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:04.241656 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a250e983-b05d-4cdc-82ad-34c60fbac09c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1313 microversion: 2.1 time: 0.259731 Aug 24 12:34:04.242767 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 97/189] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:03 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:04.280907 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-830cbd82-8644-4d5a-9bd9-199b07480079 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:04.289288 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-830cbd82-8644-4d5a-9bd9-199b07480079 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.294083 Aug 24 12:34:04.290216 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 93/190] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:03 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:05.262938 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d08bbe61-cb04-4e5c-a797-ec4a1d19e25c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:05.263541 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d08bbe61-cb04-4e5c-a797-ec4a1d19e25c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:05.269537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d08bbe61-cb04-4e5c-a797-ec4a1d19e25c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:05.270015 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d08bbe61-cb04-4e5c-a797-ec4a1d19e25c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:05.270449 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d08bbe61-cb04-4e5c-a797-ec4a1d19e25c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:05.271126 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d08bbe61-cb04-4e5c-a797-ec4a1d19e25c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:05.271571 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d08bbe61-cb04-4e5c-a797-ec4a1d19e25c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:05.272015 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d08bbe61-cb04-4e5c-a797-ec4a1d19e25c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:05.312274 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a0f87ef5-9774-49b1-b7ec-a1c541112fe0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:05.312946 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a0f87ef5-9774-49b1-b7ec-a1c541112fe0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:05.319164 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a0f87ef5-9774-49b1-b7ec-a1c541112fe0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:05.319679 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a0f87ef5-9774-49b1-b7ec-a1c541112fe0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:05.320116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a0f87ef5-9774-49b1-b7ec-a1c541112fe0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:05.320808 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a0f87ef5-9774-49b1-b7ec-a1c541112fe0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:05.321266 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a0f87ef5-9774-49b1-b7ec-a1c541112fe0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:05.321690 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a0f87ef5-9774-49b1-b7ec-a1c541112fe0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:05.460458 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d08bbe61-cb04-4e5c-a797-ec4a1d19e25c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:05.470630 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d08bbe61-cb04-4e5c-a797-ec4a1d19e25c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1313 microversion: 2.1 time: 0.211440 Aug 24 12:34:05.484043 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 98/191] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:05 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:05.499908 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a0f87ef5-9774-49b1-b7ec-a1c541112fe0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:05.508326 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a0f87ef5-9774-49b1-b7ec-a1c541112fe0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.199997 Aug 24 12:34:05.528219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 94/192] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:05 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:06.491073 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c1053b64-bd90-4d0f-857e-76bc9fe34c38 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:06.491706 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c1053b64-bd90-4d0f-857e-76bc9fe34c38 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:06.493544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:06.498554 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c1053b64-bd90-4d0f-857e-76bc9fe34c38 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:06.499953 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c1053b64-bd90-4d0f-857e-76bc9fe34c38 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:06.499953 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c1053b64-bd90-4d0f-857e-76bc9fe34c38 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:06.500314 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c1053b64-bd90-4d0f-857e-76bc9fe34c38 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:06.500764 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c1053b64-bd90-4d0f-857e-76bc9fe34c38 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:06.501185 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c1053b64-bd90-4d0f-857e-76bc9fe34c38 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:06.531015 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-cad69f1d-4428-4e8e-a1f4-ddeb49f5f56e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:06.532183 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-cad69f1d-4428-4e8e-a1f4-ddeb49f5f56e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:06.539916 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cad69f1d-4428-4e8e-a1f4-ddeb49f5f56e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:06.540458 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cad69f1d-4428-4e8e-a1f4-ddeb49f5f56e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:06.540894 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cad69f1d-4428-4e8e-a1f4-ddeb49f5f56e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:06.541583 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cad69f1d-4428-4e8e-a1f4-ddeb49f5f56e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:06.542138 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cad69f1d-4428-4e8e-a1f4-ddeb49f5f56e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:06.542559 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cad69f1d-4428-4e8e-a1f4-ddeb49f5f56e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:06.728823 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c1053b64-bd90-4d0f-857e-76bc9fe34c38 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:06.735122 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-cad69f1d-4428-4e8e-a1f4-ddeb49f5f56e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:06.737395 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c1053b64-bd90-4d0f-857e-76bc9fe34c38 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1313 microversion: 2.1 time: 0.250118 Aug 24 12:34:06.738165 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 99/193] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:06 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:06.744697 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-cad69f1d-4428-4e8e-a1f4-ddeb49f5f56e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.218437 Aug 24 12:34:06.745254 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 95/194] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:06 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:07.780940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-35426962-46e3-4998-bb15-92198c92894f tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:07.781707 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e4369a84-5065-4483-81b7-20d13f82dd22 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:07.782855 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e4369a84-5065-4483-81b7-20d13f82dd22 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:07.787756 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-35426962-46e3-4998-bb15-92198c92894f tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:07.814609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-35426962-46e3-4998-bb15-92198c92894f tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:07.820393 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-35426962-46e3-4998-bb15-92198c92894f tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:07.821002 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-35426962-46e3-4998-bb15-92198c92894f tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:07.821575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e4369a84-5065-4483-81b7-20d13f82dd22 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:07.823755 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e4369a84-5065-4483-81b7-20d13f82dd22 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:07.824187 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-35426962-46e3-4998-bb15-92198c92894f tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:07.824629 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e4369a84-5065-4483-81b7-20d13f82dd22 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:07.826200 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e4369a84-5065-4483-81b7-20d13f82dd22 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:07.826320 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-35426962-46e3-4998-bb15-92198c92894f tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:07.828700 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-35426962-46e3-4998-bb15-92198c92894f tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:07.831789 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e4369a84-5065-4483-81b7-20d13f82dd22 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:07.832329 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e4369a84-5065-4483-81b7-20d13f82dd22 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:08.095966 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-35426962-46e3-4998-bb15-92198c92894f tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:08.103242 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-35426962-46e3-4998-bb15-92198c92894f tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1313 microversion: 2.1 time: 0.348727 Aug 24 12:34:08.104428 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 100/195] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:07 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:08.145834 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e4369a84-5065-4483-81b7-20d13f82dd22 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:08.148393 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=100 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:08.155884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e4369a84-5065-4483-81b7-20d13f82dd22 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.393162 Aug 24 12:34:08.156540 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 96/196] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:07 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:09.125423 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-3ea0c4c6-0900-48c0-bd92-e459ca3d5512 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:09.126032 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-3ea0c4c6-0900-48c0-bd92-e459ca3d5512 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:09.128027 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:09.128806 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=6 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:09.134360 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3ea0c4c6-0900-48c0-bd92-e459ca3d5512 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:09.135055 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3ea0c4c6-0900-48c0-bd92-e459ca3d5512 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:09.135756 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3ea0c4c6-0900-48c0-bd92-e459ca3d5512 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:09.136780 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3ea0c4c6-0900-48c0-bd92-e459ca3d5512 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:09.141424 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3ea0c4c6-0900-48c0-bd92-e459ca3d5512 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:09.141879 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3ea0c4c6-0900-48c0-bd92-e459ca3d5512 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:09.177991 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ea780cfc-e3eb-41c9-973f-4e6006dac873 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:09.178622 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ea780cfc-e3eb-41c9-973f-4e6006dac873 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:09.181720 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:09.197831 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea780cfc-e3eb-41c9-973f-4e6006dac873 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:09.197831 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea780cfc-e3eb-41c9-973f-4e6006dac873 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:09.197831 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea780cfc-e3eb-41c9-973f-4e6006dac873 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:09.198745 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea780cfc-e3eb-41c9-973f-4e6006dac873 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:09.200171 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea780cfc-e3eb-41c9-973f-4e6006dac873 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:09.200942 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea780cfc-e3eb-41c9-973f-4e6006dac873 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:09.404738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-3ea0c4c6-0900-48c0-bd92-e459ca3d5512 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:09.417959 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-3ea0c4c6-0900-48c0-bd92-e459ca3d5512 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1313 microversion: 2.1 time: 0.294653 Aug 24 12:34:09.418579 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 101/197] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:09 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:09.427821 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ea780cfc-e3eb-41c9-973f-4e6006dac873 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:09.435925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ea780cfc-e3eb-41c9-973f-4e6006dac873 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.262647 Aug 24 12:34:09.436622 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 97/198] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:09 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:09.661807 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-4ec7cfea-2af0-46d4-9960-bed0e7edf804 req-47a7445b-57d7-4971-a2f5-9c0942c584b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1797e36f-d4b3-4860-9d3c-079391c36fc4", "name": "network-vif-plugged", "status": "completed", "tag": "afc57e8e-c5f3-4c03-8de7-ee3d56057743"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:09.674565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-4ec7cfea-2af0-46d4-9960-bed0e7edf804 req-47a7445b-57d7-4971-a2f5-9c0942c584b8 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:09.675681 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-4ec7cfea-2af0-46d4-9960-bed0e7edf804 req-47a7445b-57d7-4971-a2f5-9c0942c584b8 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:09.676396 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-4ec7cfea-2af0-46d4-9960-bed0e7edf804 req-47a7445b-57d7-4971-a2f5-9c0942c584b8 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:09.692686 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-4ec7cfea-2af0-46d4-9960-bed0e7edf804 req-47a7445b-57d7-4971-a2f5-9c0942c584b8 service nova] Creating event network-vif-plugged:afc57e8e-c5f3-4c03-8de7-ee3d56057743 for instance 1797e36f-d4b3-4860-9d3c-079391c36fc4 on hv-cinder-84890 Aug 24 12:34:09.698448 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-4ec7cfea-2af0-46d4-9960-bed0e7edf804 req-47a7445b-57d7-4971-a2f5-9c0942c584b8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041506 Aug 24 12:34:09.699291 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 102/199] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:10.440327 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c0d26e91-1eb3-40fa-adf5-ab36315e9d53 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:10.441042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c0d26e91-1eb3-40fa-adf5-ab36315e9d53 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:10.447965 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0d26e91-1eb3-40fa-adf5-ab36315e9d53 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:10.448539 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0d26e91-1eb3-40fa-adf5-ab36315e9d53 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:10.449062 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0d26e91-1eb3-40fa-adf5-ab36315e9d53 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:10.449857 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0d26e91-1eb3-40fa-adf5-ab36315e9d53 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:10.450310 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0d26e91-1eb3-40fa-adf5-ab36315e9d53 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:10.450735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0d26e91-1eb3-40fa-adf5-ab36315e9d53 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:10.459397 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2e65dd1e-046c-4918-a513-7da246a7435a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:10.460139 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2e65dd1e-046c-4918-a513-7da246a7435a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:10.466247 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2e65dd1e-046c-4918-a513-7da246a7435a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:10.466733 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2e65dd1e-046c-4918-a513-7da246a7435a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:10.467163 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2e65dd1e-046c-4918-a513-7da246a7435a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:10.467958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2e65dd1e-046c-4918-a513-7da246a7435a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:10.468424 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2e65dd1e-046c-4918-a513-7da246a7435a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:10.468839 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2e65dd1e-046c-4918-a513-7da246a7435a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:10.677508 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c0d26e91-1eb3-40fa-adf5-ab36315e9d53 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:10.681896 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2e65dd1e-046c-4918-a513-7da246a7435a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:10.694312 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c0d26e91-1eb3-40fa-adf5-ab36315e9d53 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1313 microversion: 2.1 time: 0.257941 Aug 24 12:34:10.695665 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 98/200] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:10 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:10.700790 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2e65dd1e-046c-4918-a513-7da246a7435a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.245698 Aug 24 12:34:10.704842 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 103/201] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:10 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:11.719139 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-76cf6ec9-a011-4f3e-acfa-3b3e6ae07bf2 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:11.719139 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-76cf6ec9-a011-4f3e-acfa-3b3e6ae07bf2 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:11.724707 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-08f0551f-545f-4121-9989-c5053e20d964 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:11.725306 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-08f0551f-545f-4121-9989-c5053e20d964 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:11.731418 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-08f0551f-545f-4121-9989-c5053e20d964 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:11.732044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-08f0551f-545f-4121-9989-c5053e20d964 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:11.732566 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-08f0551f-545f-4121-9989-c5053e20d964 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:11.733440 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-08f0551f-545f-4121-9989-c5053e20d964 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:11.733557 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76cf6ec9-a011-4f3e-acfa-3b3e6ae07bf2 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:11.734104 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-08f0551f-545f-4121-9989-c5053e20d964 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:11.734240 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76cf6ec9-a011-4f3e-acfa-3b3e6ae07bf2 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:11.734543 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76cf6ec9-a011-4f3e-acfa-3b3e6ae07bf2 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:11.734806 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-08f0551f-545f-4121-9989-c5053e20d964 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:11.735237 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76cf6ec9-a011-4f3e-acfa-3b3e6ae07bf2 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:11.735725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76cf6ec9-a011-4f3e-acfa-3b3e6ae07bf2 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:11.736156 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76cf6ec9-a011-4f3e-acfa-3b3e6ae07bf2 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:11.950925 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-08f0551f-545f-4121-9989-c5053e20d964 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:11.955158 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-76cf6ec9-a011-4f3e-acfa-3b3e6ae07bf2 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:11.960652 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-08f0551f-545f-4121-9989-c5053e20d964 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1521 microversion: 2.1 time: 0.239616 Aug 24 12:34:11.961296 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 104/202] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:11 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:11.962730 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-76cf6ec9-a011-4f3e-acfa-3b3e6ae07bf2 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1313 microversion: 2.1 time: 0.249247 Aug 24 12:34:11.963472 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 99/203] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:11 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:12.982263 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-82acbf05-e7cf-47f5-9a43-90058712e687 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:12.982870 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-82acbf05-e7cf-47f5-9a43-90058712e687 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:12.984433 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-4ef6b4f4-6f99-4a2a-89b5-e7b67ea634c3 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:12.985082 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-4ef6b4f4-6f99-4a2a-89b5-e7b67ea634c3 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:12.989733 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-82acbf05-e7cf-47f5-9a43-90058712e687 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:12.990227 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-82acbf05-e7cf-47f5-9a43-90058712e687 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:12.990664 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-82acbf05-e7cf-47f5-9a43-90058712e687 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:12.991364 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-82acbf05-e7cf-47f5-9a43-90058712e687 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:12.992127 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-82acbf05-e7cf-47f5-9a43-90058712e687 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:12.992400 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4ef6b4f4-6f99-4a2a-89b5-e7b67ea634c3 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:12.992520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-82acbf05-e7cf-47f5-9a43-90058712e687 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:12.992981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4ef6b4f4-6f99-4a2a-89b5-e7b67ea634c3 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:12.993419 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4ef6b4f4-6f99-4a2a-89b5-e7b67ea634c3 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:12.994459 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4ef6b4f4-6f99-4a2a-89b5-e7b67ea634c3 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:12.995030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4ef6b4f4-6f99-4a2a-89b5-e7b67ea634c3 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:12.995478 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4ef6b4f4-6f99-4a2a-89b5-e7b67ea634c3 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:13.211802 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-4ef6b4f4-6f99-4a2a-89b5-e7b67ea634c3 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:13.218767 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-82acbf05-e7cf-47f5-9a43-90058712e687 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:13.225823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-4ef6b4f4-6f99-4a2a-89b5-e7b67ea634c3 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1463 microversion: 2.1 time: 0.247028 Aug 24 12:34:13.226692 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 100/204] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:12 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1463 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:13.237003 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-82acbf05-e7cf-47f5-9a43-90058712e687 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1501 microversion: 2.1 time: 0.258606 Aug 24 12:34:13.237581 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 105/205] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:12 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1501 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:13.261461 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d445e210-92d3-4ba1-92f1-3fc9b9ff7e91 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:13.262247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d445e210-92d3-4ba1-92f1-3fc9b9ff7e91 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:13.269184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d445e210-92d3-4ba1-92f1-3fc9b9ff7e91 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:13.270260 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d445e210-92d3-4ba1-92f1-3fc9b9ff7e91 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:13.271003 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d445e210-92d3-4ba1-92f1-3fc9b9ff7e91 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:13.271910 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d445e210-92d3-4ba1-92f1-3fc9b9ff7e91 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:13.272523 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d445e210-92d3-4ba1-92f1-3fc9b9ff7e91 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:13.273134 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d445e210-92d3-4ba1-92f1-3fc9b9ff7e91 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:13.284034 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e4d9e5da-a6af-4661-bda9-7ae8e387e32d tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:13.284760 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e4d9e5da-a6af-4661-bda9-7ae8e387e32d tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:13.291838 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e4d9e5da-a6af-4661-bda9-7ae8e387e32d tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:13.292418 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e4d9e5da-a6af-4661-bda9-7ae8e387e32d tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:13.293041 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e4d9e5da-a6af-4661-bda9-7ae8e387e32d tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:13.294338 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e4d9e5da-a6af-4661-bda9-7ae8e387e32d tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:13.294960 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e4d9e5da-a6af-4661-bda9-7ae8e387e32d tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:13.295379 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e4d9e5da-a6af-4661-bda9-7ae8e387e32d tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:13.327533 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e4d9e5da-a6af-4661-bda9-7ae8e387e32d tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Going to try to terminate instance {{(pid=127308) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:34:13.433908 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-d445e210-92d3-4ba1-92f1-3fc9b9ff7e91 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:13.435746 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e4d9e5da-a6af-4661-bda9-7ae8e387e32d tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 204 len: 0 microversion: 2.1 time: 0.155217 Aug 24 12:34:13.440681 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 106/206] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:34:13 2022] DELETE /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:34:13.447531 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-108a827d-aafd-4a3e-955b-88fb11e25c48 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:13.447997 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d445e210-92d3-4ba1-92f1-3fc9b9ff7e91 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1516 microversion: 2.1 time: 0.190828 Aug 24 12:34:13.448262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-108a827d-aafd-4a3e-955b-88fb11e25c48 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:13.449077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 101/207] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:13 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:13.455824 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-108a827d-aafd-4a3e-955b-88fb11e25c48 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:13.456307 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-108a827d-aafd-4a3e-955b-88fb11e25c48 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:13.456748 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-108a827d-aafd-4a3e-955b-88fb11e25c48 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:13.457439 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-108a827d-aafd-4a3e-955b-88fb11e25c48 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:13.457895 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-108a827d-aafd-4a3e-955b-88fb11e25c48 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:13.458324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-108a827d-aafd-4a3e-955b-88fb11e25c48 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:13.631030 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-108a827d-aafd-4a3e-955b-88fb11e25c48 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:13.643139 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-108a827d-aafd-4a3e-955b-88fb11e25c48 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1469 microversion: 2.1 time: 0.200355 Aug 24 12:34:13.644740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 107/208] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:13 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1469 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:14.667202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-4d31c1e5-9a8e-441d-bf29-e6c5bdf3efd0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:14.667845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-4d31c1e5-9a8e-441d-bf29-e6c5bdf3efd0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:14.677001 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4d31c1e5-9a8e-441d-bf29-e6c5bdf3efd0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:14.677469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4d31c1e5-9a8e-441d-bf29-e6c5bdf3efd0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:14.678165 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4d31c1e5-9a8e-441d-bf29-e6c5bdf3efd0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:14.679037 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4d31c1e5-9a8e-441d-bf29-e6c5bdf3efd0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:14.679770 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4d31c1e5-9a8e-441d-bf29-e6c5bdf3efd0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:14.680273 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4d31c1e5-9a8e-441d-bf29-e6c5bdf3efd0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:14.841141 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-4d31c1e5-9a8e-441d-bf29-e6c5bdf3efd0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:14.850417 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-4d31c1e5-9a8e-441d-bf29-e6c5bdf3efd0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1469 microversion: 2.1 time: 0.187894 Aug 24 12:34:14.851065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 102/209] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:14 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:14.932416 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-82cd11c2-a6aa-4ef7-a5df-e119b7d7e23b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:14.934743 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-82cd11c2-a6aa-4ef7-a5df-e119b7d7e23b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:14.941371 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-82cd11c2-a6aa-4ef7-a5df-e119b7d7e23b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:14.941794 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-82cd11c2-a6aa-4ef7-a5df-e119b7d7e23b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:14.942231 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-82cd11c2-a6aa-4ef7-a5df-e119b7d7e23b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:14.942928 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-82cd11c2-a6aa-4ef7-a5df-e119b7d7e23b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:14.943383 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-82cd11c2-a6aa-4ef7-a5df-e119b7d7e23b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:14.943837 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-82cd11c2-a6aa-4ef7-a5df-e119b7d7e23b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:14.970156 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-82cd11c2-a6aa-4ef7-a5df-e119b7d7e23b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lazy-loading 'flavor' on Instance uuid a3027685-43d2-43dc-92d2-ac44b036c061 {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:34:15.065985 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:15.084281 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-82cd11c2-a6aa-4ef7-a5df-e119b7d7e23b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "POST /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061/action" status: 200 len: 32 microversion: 2.1 time: 0.156283 Aug 24 12:34:15.085192 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 108/210] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 12:34:14 2022] POST /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:34:15.096883 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3529a107-83c1-4154-afac-4b58c20bb755 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:15.097551 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3529a107-83c1-4154-afac-4b58c20bb755 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:15.114227 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3529a107-83c1-4154-afac-4b58c20bb755 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:15.114726 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3529a107-83c1-4154-afac-4b58c20bb755 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:15.115373 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3529a107-83c1-4154-afac-4b58c20bb755 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:15.116180 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3529a107-83c1-4154-afac-4b58c20bb755 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:15.116644 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3529a107-83c1-4154-afac-4b58c20bb755 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:15.117488 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3529a107-83c1-4154-afac-4b58c20bb755 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:15.297657 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-3529a107-83c1-4154-afac-4b58c20bb755 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:15.305491 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3529a107-83c1-4154-afac-4b58c20bb755 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.214097 Aug 24 12:34:15.306040 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 103/211] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:15 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:15.879675 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-0bf63dd5-bca9-4562-b05e-8a8cae7f27f0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:15.879675 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-0bf63dd5-bca9-4562-b05e-8a8cae7f27f0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:15.897176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0bf63dd5-bca9-4562-b05e-8a8cae7f27f0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:15.897670 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0bf63dd5-bca9-4562-b05e-8a8cae7f27f0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:15.904270 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0bf63dd5-bca9-4562-b05e-8a8cae7f27f0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:15.905110 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0bf63dd5-bca9-4562-b05e-8a8cae7f27f0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:15.905644 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0bf63dd5-bca9-4562-b05e-8a8cae7f27f0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:15.906055 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0bf63dd5-bca9-4562-b05e-8a8cae7f27f0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:16.172407 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-0bf63dd5-bca9-4562-b05e-8a8cae7f27f0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:16.190970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-0bf63dd5-bca9-4562-b05e-8a8cae7f27f0 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1469 microversion: 2.1 time: 0.321321 Aug 24 12:34:16.193818 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 109/212] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:15 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1469 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:16.326808 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b962a46e-959f-4bc9-ba57-556d689f8298 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:16.339485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-b962a46e-959f-4bc9-ba57-556d689f8298 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:16.369302 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b962a46e-959f-4bc9-ba57-556d689f8298 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:16.376381 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b962a46e-959f-4bc9-ba57-556d689f8298 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:16.376822 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b962a46e-959f-4bc9-ba57-556d689f8298 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:16.377575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b962a46e-959f-4bc9-ba57-556d689f8298 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:16.378016 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b962a46e-959f-4bc9-ba57-556d689f8298 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:16.382220 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b962a46e-959f-4bc9-ba57-556d689f8298 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:16.577848 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-77ad3457-7b74-49cf-b82c-088eabfdc494 req-8d180d94-2738-486b-91b0-5c3040a0232e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1797e36f-d4b3-4860-9d3c-079391c36fc4", "name": "network-vif-deleted", "tag": "afc57e8e-c5f3-4c03-8de7-ee3d56057743"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:16.616511 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-77ad3457-7b74-49cf-b82c-088eabfdc494 req-8d180d94-2738-486b-91b0-5c3040a0232e service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:16.621308 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-77ad3457-7b74-49cf-b82c-088eabfdc494 req-8d180d94-2738-486b-91b0-5c3040a0232e service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:16.624767 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-77ad3457-7b74-49cf-b82c-088eabfdc494 req-8d180d94-2738-486b-91b0-5c3040a0232e service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:16.669119 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-77ad3457-7b74-49cf-b82c-088eabfdc494 req-8d180d94-2738-486b-91b0-5c3040a0232e service nova] Creating event network-vif-deleted:afc57e8e-c5f3-4c03-8de7-ee3d56057743 for instance 1797e36f-d4b3-4860-9d3c-079391c36fc4 on hv-cinder-84890 Aug 24 12:34:16.682943 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-77ad3457-7b74-49cf-b82c-088eabfdc494 req-8d180d94-2738-486b-91b0-5c3040a0232e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109409 Aug 24 12:34:16.690075 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 110/213] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:34:16.930341 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b962a46e-959f-4bc9-ba57-556d689f8298 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:16.942599 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b962a46e-959f-4bc9-ba57-556d689f8298 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.619778 Aug 24 12:34:16.944004 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 104/214] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:16 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:17.214138 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-736944f1-70de-4f53-b5fc-18c5dc9db655 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:17.214852 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-736944f1-70de-4f53-b5fc-18c5dc9db655 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:17.223325 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-736944f1-70de-4f53-b5fc-18c5dc9db655 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:17.223871 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-736944f1-70de-4f53-b5fc-18c5dc9db655 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:17.225205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-736944f1-70de-4f53-b5fc-18c5dc9db655 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:17.226081 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-736944f1-70de-4f53-b5fc-18c5dc9db655 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:17.226540 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-736944f1-70de-4f53-b5fc-18c5dc9db655 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:17.226966 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-736944f1-70de-4f53-b5fc-18c5dc9db655 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:17.263559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-736944f1-70de-4f53-b5fc-18c5dc9db655 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:17.264520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-736944f1-70de-4f53-b5fc-18c5dc9db655 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:17.265227 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-736944f1-70de-4f53-b5fc-18c5dc9db655 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:17.266111 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-736944f1-70de-4f53-b5fc-18c5dc9db655 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lazy-loading 'fault' on Instance uuid 1797e36f-d4b3-4860-9d3c-079391c36fc4 {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:34:17.324119 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-736944f1-70de-4f53-b5fc-18c5dc9db655 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af58e3ca6394bfa8ca34007c4ece01a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdabfd06f064b05a6d8ec06b4fca329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:17.334192 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-736944f1-70de-4f53-b5fc-18c5dc9db655 tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 200 len: 1303 microversion: 2.1 time: 0.124122 Aug 24 12:34:17.335426 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 111/215] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:17 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:17.964599 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-76e9e872-e259-4d03-a0b8-254c068db07e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:17.965532 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-76e9e872-e259-4d03-a0b8-254c068db07e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:17.972005 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76e9e872-e259-4d03-a0b8-254c068db07e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:17.973174 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76e9e872-e259-4d03-a0b8-254c068db07e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:17.973774 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76e9e872-e259-4d03-a0b8-254c068db07e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:17.979015 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76e9e872-e259-4d03-a0b8-254c068db07e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:17.982218 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76e9e872-e259-4d03-a0b8-254c068db07e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:17.983233 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76e9e872-e259-4d03-a0b8-254c068db07e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:18.297545 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-76e9e872-e259-4d03-a0b8-254c068db07e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:18.306828 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-76e9e872-e259-4d03-a0b8-254c068db07e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.345376 Aug 24 12:34:18.307595 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 105/216] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:17 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:18.355061 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-de870b4e-6ce6-4e8b-84a6-2f6aba677f8c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:18.355929 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-de870b4e-6ce6-4e8b-84a6-2f6aba677f8c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] [instance: 1797e36f-d4b3-4860-9d3c-079391c36fc4] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:18.364263 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-de870b4e-6ce6-4e8b-84a6-2f6aba677f8c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:18.364751 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-de870b4e-6ce6-4e8b-84a6-2f6aba677f8c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:18.365175 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-de870b4e-6ce6-4e8b-84a6-2f6aba677f8c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:18.365865 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-de870b4e-6ce6-4e8b-84a6-2f6aba677f8c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:18.366307 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-de870b4e-6ce6-4e8b-84a6-2f6aba677f8c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:18.366718 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-de870b4e-6ce6-4e8b-84a6-2f6aba677f8c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:18.387926 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-de870b4e-6ce6-4e8b-84a6-2f6aba677f8c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] HTTP exception thrown: Instance 1797e36f-d4b3-4860-9d3c-079391c36fc4 could not be found. Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-de870b4e-6ce6-4e8b-84a6-2f6aba677f8c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Request method failure captured: Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 HTTP/1.1 Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhq0CWnIfINSvAWVUdqPlwEYD7aJGpS3niy00y-hTxBajN9pZ64Z2_kxJXuK0TK7PcDhUMb-sjHCV-hznPR4JVc3jCFAZkOQF_82ZsO9ADRD-MzjzbW-GfXXndyfK8H2r6YM3_c8TK4lc_XmWLUq6DTls5nPg11TEZTgm-p9KBjaAi8 Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 2bdabfd06f064b05a6d8ec06b4fca329 Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-VolumesNegativeTest-1114435078 Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:34:18.390311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:34:18.392072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2bdabfd06f064b05a6d8ec06b4fca329"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2bdabfd06f064b05a6d8ec06b4fca329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2bdabfd06f064b05a6d8ec06b4fca329"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2bdabfd06f064b05a6d8ec06b4fca329"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:34:18.392072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-VolumesNegativeTest-1114435078 Aug 24 12:34:18.392072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 2bdabfd06f064b05a6d8ec06b4fca329 Aug 24 12:34:18.392072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-VolumesNegativeTest-1114435078 Aug 24 12:34:18.392072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-VolumesNegativeTest-1114435078-project Aug 24 12:34:18.392072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:34:18.392072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:34:18.392072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 2af58e3ca6394bfa8ca34007c4ece01a Aug 24 12:34:18.392072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-VolumesNegativeTest-1114435078-project Aug 24 12:34:18.392072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:34:18.392072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance 1797e36f-d4b3-4860-9d3c-079391c36fc4 could not be found. Aug 24 12:34:18.392072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '1797e36f-d4b3-4860-9d3c-079391c36fc4'} Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1797e36f-d4b3-4860-9d3c-079391c36fc4 could not be found. Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:34:18.392957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1797e36f-d4b3-4860-9d3c-079391c36fc4 could not be found. Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1797e36f-d4b3-4860-9d3c-079391c36fc4 could not be found. Aug 24 12:34:18.394408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:34:18.396601 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-de870b4e-6ce6-4e8b-84a6-2f6aba677f8c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] Returning 404 to user: Instance 1797e36f-d4b3-4860-9d3c-079391c36fc4 could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:34:18.399025 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-de870b4e-6ce6-4e8b-84a6-2f6aba677f8c tempest-VolumesNegativeTest-1114435078 tempest-VolumesNegativeTest-1114435078-project] 10.222.0.58 "GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4" status: 404 len: 111 microversion: 2.1 time: 0.046616 Aug 24 12:34:18.400179 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 112/217] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:18 2022] GET /compute/v2.1/servers/1797e36f-d4b3-4860-9d3c-079391c36fc4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:34:19.329231 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d2237510-eaf6-4129-ab9a-cc4451b2151c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:19.329983 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d2237510-eaf6-4129-ab9a-cc4451b2151c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:19.345016 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d2237510-eaf6-4129-ab9a-cc4451b2151c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:19.345801 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d2237510-eaf6-4129-ab9a-cc4451b2151c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:19.347023 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d2237510-eaf6-4129-ab9a-cc4451b2151c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:19.351439 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d2237510-eaf6-4129-ab9a-cc4451b2151c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:19.352057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d2237510-eaf6-4129-ab9a-cc4451b2151c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:19.352598 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d2237510-eaf6-4129-ab9a-cc4451b2151c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:19.620283 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-d2237510-eaf6-4129-ab9a-cc4451b2151c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:19.632946 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d2237510-eaf6-4129-ab9a-cc4451b2151c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.308208 Aug 24 12:34:19.636943 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 106/218] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:19 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:20.660220 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1e921c9a-592e-4ba8-947a-e712e2283fac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:20.661465 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1e921c9a-592e-4ba8-947a-e712e2283fac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:20.674272 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e921c9a-592e-4ba8-947a-e712e2283fac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:20.677079 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e921c9a-592e-4ba8-947a-e712e2283fac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:20.677916 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e921c9a-592e-4ba8-947a-e712e2283fac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:20.678745 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e921c9a-592e-4ba8-947a-e712e2283fac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:20.680844 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e921c9a-592e-4ba8-947a-e712e2283fac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:20.682272 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e921c9a-592e-4ba8-947a-e712e2283fac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:20.924425 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1e921c9a-592e-4ba8-947a-e712e2283fac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:20.938220 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1e921c9a-592e-4ba8-947a-e712e2283fac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.283732 Aug 24 12:34:20.939214 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 113/219] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:20 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:21.961261 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2aa7cf06-20f8-4617-acae-d681a67e39b5 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:21.963648 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2aa7cf06-20f8-4617-acae-d681a67e39b5 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:21.980831 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2aa7cf06-20f8-4617-acae-d681a67e39b5 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:21.982579 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2aa7cf06-20f8-4617-acae-d681a67e39b5 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:21.983405 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2aa7cf06-20f8-4617-acae-d681a67e39b5 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:21.984413 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2aa7cf06-20f8-4617-acae-d681a67e39b5 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:21.985012 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2aa7cf06-20f8-4617-acae-d681a67e39b5 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:21.985669 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2aa7cf06-20f8-4617-acae-d681a67e39b5 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:22.396106 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2aa7cf06-20f8-4617-acae-d681a67e39b5 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:22.408975 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2aa7cf06-20f8-4617-acae-d681a67e39b5 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.452961 Aug 24 12:34:22.412069 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 107/220] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:21 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:23.435423 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-28244239-5669-4d7a-bee6-c370bed1f72f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:23.436425 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-28244239-5669-4d7a-bee6-c370bed1f72f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:23.450259 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-28244239-5669-4d7a-bee6-c370bed1f72f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:23.453565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-28244239-5669-4d7a-bee6-c370bed1f72f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:23.454215 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-28244239-5669-4d7a-bee6-c370bed1f72f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:23.457295 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-28244239-5669-4d7a-bee6-c370bed1f72f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:23.460298 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-28244239-5669-4d7a-bee6-c370bed1f72f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:23.463599 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-28244239-5669-4d7a-bee6-c370bed1f72f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:23.678624 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-28244239-5669-4d7a-bee6-c370bed1f72f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:23.689330 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-28244239-5669-4d7a-bee6-c370bed1f72f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.260536 Aug 24 12:34:23.690316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 114/221] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:23 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:24.053238 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9b313b5c-630c-4e25-ac1f-f4501626d995 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:24.054283 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-9b313b5c-630c-4e25-ac1f-f4501626d995 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:24.067115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b313b5c-630c-4e25-ac1f-f4501626d995 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:24.067853 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b313b5c-630c-4e25-ac1f-f4501626d995 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:24.068432 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b313b5c-630c-4e25-ac1f-f4501626d995 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:24.069283 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b313b5c-630c-4e25-ac1f-f4501626d995 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:24.069903 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b313b5c-630c-4e25-ac1f-f4501626d995 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:24.070490 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b313b5c-630c-4e25-ac1f-f4501626d995 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:24.114502 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9b313b5c-630c-4e25-ac1f-f4501626d995 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/ips" status: 200 len: 151 microversion: 2.20 time: 0.067559 Aug 24 12:34:24.115458 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 108/222] 10.222.0.58 () {60 vars in 1289 bytes} [Wed Aug 24 12:34:24 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/ips => generated 151 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:34:24.722354 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d39b1bcb-5db5-49a4-925e-656e1a7d9f08 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:24.723305 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d39b1bcb-5db5-49a4-925e-656e1a7d9f08 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:24.731383 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d39b1bcb-5db5-49a4-925e-656e1a7d9f08 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:24.736627 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d39b1bcb-5db5-49a4-925e-656e1a7d9f08 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:24.737826 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d39b1bcb-5db5-49a4-925e-656e1a7d9f08 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:24.738591 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d39b1bcb-5db5-49a4-925e-656e1a7d9f08 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:24.739100 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d39b1bcb-5db5-49a4-925e-656e1a7d9f08 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:24.740114 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d39b1bcb-5db5-49a4-925e-656e1a7d9f08 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:25.042809 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d39b1bcb-5db5-49a4-925e-656e1a7d9f08 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:25.056826 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d39b1bcb-5db5-49a4-925e-656e1a7d9f08 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.341612 Aug 24 12:34:25.067725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 115/223] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:24 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:26.083428 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-054afc0d-a1f8-49ba-8be0-30236c24581f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:26.084207 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-054afc0d-a1f8-49ba-8be0-30236c24581f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:26.098797 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-054afc0d-a1f8-49ba-8be0-30236c24581f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.098999 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-054afc0d-a1f8-49ba-8be0-30236c24581f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.107321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-054afc0d-a1f8-49ba-8be0-30236c24581f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.108516 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-054afc0d-a1f8-49ba-8be0-30236c24581f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.109043 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-054afc0d-a1f8-49ba-8be0-30236c24581f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.109389 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-054afc0d-a1f8-49ba-8be0-30236c24581f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.425151 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-054afc0d-a1f8-49ba-8be0-30236c24581f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:26.437126 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-054afc0d-a1f8-49ba-8be0-30236c24581f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.357171 Aug 24 12:34:26.439546 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 109/224] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:26 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:26.465259 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4eb466af-a928-46a7-8f3c-8a8e1bf1379e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:26.466408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4eb466af-a928-46a7-8f3c-8a8e1bf1379e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:26.478253 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4eb466af-a928-46a7-8f3c-8a8e1bf1379e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.482375 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4eb466af-a928-46a7-8f3c-8a8e1bf1379e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.483838 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4eb466af-a928-46a7-8f3c-8a8e1bf1379e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.485876 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4eb466af-a928-46a7-8f3c-8a8e1bf1379e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.487919 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4eb466af-a928-46a7-8f3c-8a8e1bf1379e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.488360 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4eb466af-a928-46a7-8f3c-8a8e1bf1379e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.547902 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4eb466af-a928-46a7-8f3c-8a8e1bf1379e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda/ips" status: 200 len: 150 microversion: 2.1 time: 0.086692 Aug 24 12:34:26.554869 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 116/225] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 12:34:26 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda/ips => generated 150 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:26.908167 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-14db7098-7009-4a74-b4ba-8cce37304eb8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:26.909143 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-14db7098-7009-4a74-b4ba-8cce37304eb8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:26.914254 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2e23c49a-4bde-4fc8-973e-6dbfa320440e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:26.914873 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2e23c49a-4bde-4fc8-973e-6dbfa320440e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:26.924919 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2e23c49a-4bde-4fc8-973e-6dbfa320440e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.925703 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2e23c49a-4bde-4fc8-973e-6dbfa320440e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.926836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2e23c49a-4bde-4fc8-973e-6dbfa320440e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.928267 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2e23c49a-4bde-4fc8-973e-6dbfa320440e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.929475 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-14db7098-7009-4a74-b4ba-8cce37304eb8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.929968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2e23c49a-4bde-4fc8-973e-6dbfa320440e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.930584 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2e23c49a-4bde-4fc8-973e-6dbfa320440e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.934319 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-14db7098-7009-4a74-b4ba-8cce37304eb8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.934815 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-14db7098-7009-4a74-b4ba-8cce37304eb8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.935557 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-14db7098-7009-4a74-b4ba-8cce37304eb8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.938966 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-14db7098-7009-4a74-b4ba-8cce37304eb8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.939655 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-14db7098-7009-4a74-b4ba-8cce37304eb8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.968132 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2e23c49a-4bde-4fc8-973e-6dbfa320440e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/ips" status: 200 len: 147 microversion: 2.1 time: 0.058909 Aug 24 12:34:26.969253 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 117/226] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 12:34:26 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/ips => generated 147 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:27.012155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.objects.instance [None req-14db7098-7009-4a74-b4ba-8cce37304eb8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lazy-loading 'flavor' on Instance uuid e09b5ebb-0578-465d-a6ad-03383fdeca05 {{(pid=127307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:34:27.463078 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-fc2e589d-ef55-4681-be38-6383b7a2d788 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:27.464254 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-fc2e589d-ef55-4681-be38-6383b7a2d788 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:27.482437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fc2e589d-ef55-4681-be38-6383b7a2d788 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:27.483642 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fc2e589d-ef55-4681-be38-6383b7a2d788 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:27.487975 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fc2e589d-ef55-4681-be38-6383b7a2d788 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:27.488815 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fc2e589d-ef55-4681-be38-6383b7a2d788 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:27.489422 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fc2e589d-ef55-4681-be38-6383b7a2d788 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:27.489858 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fc2e589d-ef55-4681-be38-6383b7a2d788 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:27.664899 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-14db7098-7009-4a74-b4ba-8cce37304eb8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "POST /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/action" status: 202 len: 0 microversion: 2.20 time: 0.767800 Aug 24 12:34:27.684040 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 110/227] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 12:34:26 2022] POST /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/action => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:34:27.695726 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-958796c2-20bf-4c21-bdfa-ee30e82b3f17 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:27.705316 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-958796c2-20bf-4c21-bdfa-ee30e82b3f17 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:27.715285 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-958796c2-20bf-4c21-bdfa-ee30e82b3f17 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:27.718676 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-958796c2-20bf-4c21-bdfa-ee30e82b3f17 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:27.719465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-958796c2-20bf-4c21-bdfa-ee30e82b3f17 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:27.722045 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-958796c2-20bf-4c21-bdfa-ee30e82b3f17 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:27.722622 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-958796c2-20bf-4c21-bdfa-ee30e82b3f17 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:27.724122 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-958796c2-20bf-4c21-bdfa-ee30e82b3f17 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:27.787399 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-fc2e589d-ef55-4681-be38-6383b7a2d788 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:27.797297 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-fc2e589d-ef55-4681-be38-6383b7a2d788 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.342161 Aug 24 12:34:27.798443 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 118/228] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:27 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:27.968707 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-958796c2-20bf-4c21-bdfa-ee30e82b3f17 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:27.971535 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:28.002750 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-958796c2-20bf-4c21-bdfa-ee30e82b3f17 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:28.004786 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-958796c2-20bf-4c21-bdfa-ee30e82b3f17 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:28.006766 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-958796c2-20bf-4c21-bdfa-ee30e82b3f17 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.320843 Aug 24 12:34:28.007976 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 111/229] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:27 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:28.279724 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-fb37f23d-8723-4c68-80c7-9c9417925052 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b76cc74-757b-4ea4-b5d0-bb8852a5ba0d"}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:28.286623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-fb37f23d-8723-4c68-80c7-9c9417925052 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:28.297096 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb37f23d-8723-4c68-80c7-9c9417925052 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:28.297703 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb37f23d-8723-4c68-80c7-9c9417925052 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:28.298223 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb37f23d-8723-4c68-80c7-9c9417925052 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:28.299151 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb37f23d-8723-4c68-80c7-9c9417925052 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:28.299961 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb37f23d-8723-4c68-80c7-9c9417925052 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:28.300581 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb37f23d-8723-4c68-80c7-9c9417925052 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:28.819280 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-eef612a5-6190-4962-8ac9-b21bde58763b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:28.820697 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-eef612a5-6190-4962-8ac9-b21bde58763b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:28.830115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=52 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:28.836978 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-eef612a5-6190-4962-8ac9-b21bde58763b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:28.837849 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-eef612a5-6190-4962-8ac9-b21bde58763b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:28.839048 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-eef612a5-6190-4962-8ac9-b21bde58763b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:28.841206 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-eef612a5-6190-4962-8ac9-b21bde58763b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:28.845899 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-eef612a5-6190-4962-8ac9-b21bde58763b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:28.846775 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-eef612a5-6190-4962-8ac9-b21bde58763b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:28.944787 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-fb37f23d-8723-4c68-80c7-9c9417925052 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "POST /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.669848 Aug 24 12:34:28.945633 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 119/230] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 12:34:28 2022] POST /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda/os-volume_attachments => generated 194 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:29.042650 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1a17db38-0c82-4516-b163-6bed45cc5fca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:29.043544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1a17db38-0c82-4516-b163-6bed45cc5fca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:29.052814 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1a17db38-0c82-4516-b163-6bed45cc5fca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:29.068122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1a17db38-0c82-4516-b163-6bed45cc5fca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:29.071114 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1a17db38-0c82-4516-b163-6bed45cc5fca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:29.077253 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1a17db38-0c82-4516-b163-6bed45cc5fca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:29.082011 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1a17db38-0c82-4516-b163-6bed45cc5fca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:29.088774 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1a17db38-0c82-4516-b163-6bed45cc5fca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:29.564056 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1a17db38-0c82-4516-b163-6bed45cc5fca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:29.579883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1a17db38-0c82-4516-b163-6bed45cc5fca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:29.582798 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1a17db38-0c82-4516-b163-6bed45cc5fca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:29.585374 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1a17db38-0c82-4516-b163-6bed45cc5fca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.547149 Aug 24 12:34:29.604024 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 120/231] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:29 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:29.605674 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-eef612a5-6190-4962-8ac9-b21bde58763b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:29.633869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-eef612a5-6190-4962-8ac9-b21bde58763b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.819953 Aug 24 12:34:29.637015 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 112/232] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:28 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:29.831839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3835a7fd-69a4-48d6-9fa1-ddcd6e0a5888 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b2f545c-d822-460f-80b9-5a6852b6b06e"}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:29.834608 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3835a7fd-69a4-48d6-9fa1-ddcd6e0a5888 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:29.855208 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3835a7fd-69a4-48d6-9fa1-ddcd6e0a5888 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:29.855861 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3835a7fd-69a4-48d6-9fa1-ddcd6e0a5888 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:29.856374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3835a7fd-69a4-48d6-9fa1-ddcd6e0a5888 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:29.858202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3835a7fd-69a4-48d6-9fa1-ddcd6e0a5888 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:29.861988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3835a7fd-69a4-48d6-9fa1-ddcd6e0a5888 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:29.862660 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3835a7fd-69a4-48d6-9fa1-ddcd6e0a5888 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:29.998467 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-480bc687-6b8e-4b64-b665-83a9e706b758 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Action: 'create', calling method: .version_select at 0x7f4696d52700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1946886811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7KcgeJxMtwivCM4LI6rymm6677OuoZeSFe3bqsywCd/YrKVbuotzT3U07xiOrq2Pbzdc1KZgbNr6VSDQzo2hY6H+dt2LHFE2xkIZpe5Bb2bCuEK5fVRXCnTqvT+h+6ug=="}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:30.018276 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-480bc687-6b8e-4b64-b665-83a9e706b758 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Getting quotas for project aee96e55a6a34dbb81847961d87abad0. Resources: {'key_pairs'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:34:30.022363 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-480bc687-6b8e-4b64-b665-83a9e706b758 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Getting quotas for user 18f8f419b523440f8a4ca06dc83bff40 and project aee96e55a6a34dbb81847961d87abad0. Resources: {'key_pairs'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:34:30.060598 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-480bc687-6b8e-4b64-b665-83a9e706b758 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.453911 Aug 24 12:34:30.061744 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 121/233] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 12:34:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:30.242544 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3835a7fd-69a4-48d6-9fa1-ddcd6e0a5888 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "POST /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.420684 Aug 24 12:34:30.243550 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 113/234] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 12:34:29 2022] POST /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:34:30.612214 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4abcb317-6296-4434-beb1-fabce2f658ec tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:30.613160 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4abcb317-6296-4434-beb1-fabce2f658ec tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:30.626143 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4abcb317-6296-4434-beb1-fabce2f658ec tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:30.627703 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4abcb317-6296-4434-beb1-fabce2f658ec tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:30.628171 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4abcb317-6296-4434-beb1-fabce2f658ec tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.629018 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4abcb317-6296-4434-beb1-fabce2f658ec tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:30.629487 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4abcb317-6296-4434-beb1-fabce2f658ec tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:30.632870 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4abcb317-6296-4434-beb1-fabce2f658ec tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.656333 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a7727aef-02d6-4110-8c3b-e9af58a776f7 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:30.657199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a7727aef-02d6-4110-8c3b-e9af58a776f7 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:30.668686 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7727aef-02d6-4110-8c3b-e9af58a776f7 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:30.669440 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7727aef-02d6-4110-8c3b-e9af58a776f7 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:30.671348 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7727aef-02d6-4110-8c3b-e9af58a776f7 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.672297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7727aef-02d6-4110-8c3b-e9af58a776f7 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:30.673132 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7727aef-02d6-4110-8c3b-e9af58a776f7 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:30.673566 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7727aef-02d6-4110-8c3b-e9af58a776f7 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.965099 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4abcb317-6296-4434-beb1-fabce2f658ec tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:30.976140 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4abcb317-6296-4434-beb1-fabce2f658ec tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:30.977050 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a7727aef-02d6-4110-8c3b-e9af58a776f7 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:30.978299 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4abcb317-6296-4434-beb1-fabce2f658ec tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:30.979697 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4abcb317-6296-4434-beb1-fabce2f658ec tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.372642 Aug 24 12:34:30.980443 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 122/235] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:30 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:30.987016 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a7727aef-02d6-4110-8c3b-e9af58a776f7 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.334255 Aug 24 12:34:30.996276 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 114/236] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:30 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:32.005600 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-171452c9-9481-4d14-a20b-ce915299b2da tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:32.006213 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-171452c9-9481-4d14-a20b-ce915299b2da tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:32.010236 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3b72fbe6-20ad-40a1-93ce-50f7f7ae69ce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:32.011020 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3b72fbe6-20ad-40a1-93ce-50f7f7ae69ce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:32.013999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-171452c9-9481-4d14-a20b-ce915299b2da tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:32.015478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-171452c9-9481-4d14-a20b-ce915299b2da tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:32.016134 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-171452c9-9481-4d14-a20b-ce915299b2da tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:32.018663 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-171452c9-9481-4d14-a20b-ce915299b2da tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:32.019876 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-171452c9-9481-4d14-a20b-ce915299b2da tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:32.021485 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-171452c9-9481-4d14-a20b-ce915299b2da tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:32.044679 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3b72fbe6-20ad-40a1-93ce-50f7f7ae69ce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:32.055020 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3b72fbe6-20ad-40a1-93ce-50f7f7ae69ce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:32.055640 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3b72fbe6-20ad-40a1-93ce-50f7f7ae69ce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:32.056402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3b72fbe6-20ad-40a1-93ce-50f7f7ae69ce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:32.056879 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3b72fbe6-20ad-40a1-93ce-50f7f7ae69ce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:32.057342 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3b72fbe6-20ad-40a1-93ce-50f7f7ae69ce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:32.301709 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-171452c9-9481-4d14-a20b-ce915299b2da tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:32.312447 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-171452c9-9481-4d14-a20b-ce915299b2da tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:32.313654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-3b72fbe6-20ad-40a1-93ce-50f7f7ae69ce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:32.314110 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-171452c9-9481-4d14-a20b-ce915299b2da tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:32.315439 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-171452c9-9481-4d14-a20b-ce915299b2da tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.315264 Aug 24 12:34:32.316388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 123/237] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:31 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:32.322310 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3b72fbe6-20ad-40a1-93ce-50f7f7ae69ce tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.317999 Aug 24 12:34:32.322905 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 115/238] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:32 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:33.338511 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1b804795-5b19-486a-a8d9-aff32865e0cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:33.339567 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1b804795-5b19-486a-a8d9-aff32865e0cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:33.347552 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1b804795-5b19-486a-a8d9-aff32865e0cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:33.348311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1b804795-5b19-486a-a8d9-aff32865e0cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:33.348902 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1b804795-5b19-486a-a8d9-aff32865e0cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:33.349347 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-92f91eaa-ac69-45ae-bd26-587bf1bb3e9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:33.350328 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1b804795-5b19-486a-a8d9-aff32865e0cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:33.350992 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1b804795-5b19-486a-a8d9-aff32865e0cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:33.351585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-92f91eaa-ac69-45ae-bd26-587bf1bb3e9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:33.351818 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1b804795-5b19-486a-a8d9-aff32865e0cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:33.364152 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-92f91eaa-ac69-45ae-bd26-587bf1bb3e9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:33.364769 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-92f91eaa-ac69-45ae-bd26-587bf1bb3e9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:33.365502 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-92f91eaa-ac69-45ae-bd26-587bf1bb3e9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:33.366287 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-92f91eaa-ac69-45ae-bd26-587bf1bb3e9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:33.366913 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-92f91eaa-ac69-45ae-bd26-587bf1bb3e9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:33.367741 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-92f91eaa-ac69-45ae-bd26-587bf1bb3e9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:33.900694 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1b804795-5b19-486a-a8d9-aff32865e0cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:33.907880 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-92f91eaa-ac69-45ae-bd26-587bf1bb3e9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:33.909583 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1b804795-5b19-486a-a8d9-aff32865e0cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:33.911962 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1b804795-5b19-486a-a8d9-aff32865e0cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:33.913132 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1b804795-5b19-486a-a8d9-aff32865e0cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.578640 Aug 24 12:34:33.913860 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 124/239] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:33 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:33.930178 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-92f91eaa-ac69-45ae-bd26-587bf1bb3e9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.589501 Aug 24 12:34:33.930821 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 116/240] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:33 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:34.937007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-166cda51-660b-4e0c-b7fe-33220d38efb7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:34.937613 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-166cda51-660b-4e0c-b7fe-33220d38efb7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:34.944019 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-166cda51-660b-4e0c-b7fe-33220d38efb7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:34.944499 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-166cda51-660b-4e0c-b7fe-33220d38efb7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:34.944929 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-166cda51-660b-4e0c-b7fe-33220d38efb7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:34.945609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-166cda51-660b-4e0c-b7fe-33220d38efb7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:34.946088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-166cda51-660b-4e0c-b7fe-33220d38efb7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:34.946504 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-166cda51-660b-4e0c-b7fe-33220d38efb7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:34.953443 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-243d6342-cbc6-4760-b4f1-eabd378be494 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:34.954080 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-243d6342-cbc6-4760-b4f1-eabd378be494 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:34.960345 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-243d6342-cbc6-4760-b4f1-eabd378be494 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:34.960825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-243d6342-cbc6-4760-b4f1-eabd378be494 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:34.961255 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-243d6342-cbc6-4760-b4f1-eabd378be494 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:34.961941 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-243d6342-cbc6-4760-b4f1-eabd378be494 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:34.962399 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-243d6342-cbc6-4760-b4f1-eabd378be494 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:34.962810 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-243d6342-cbc6-4760-b4f1-eabd378be494 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:35.144716 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-166cda51-660b-4e0c-b7fe-33220d38efb7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:35.152868 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-166cda51-660b-4e0c-b7fe-33220d38efb7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:35.154602 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-166cda51-660b-4e0c-b7fe-33220d38efb7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:35.156046 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-166cda51-660b-4e0c-b7fe-33220d38efb7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.222918 Aug 24 12:34:35.156163 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-243d6342-cbc6-4760-b4f1-eabd378be494 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:35.156603 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 125/241] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:34 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:35.163789 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-243d6342-cbc6-4760-b4f1-eabd378be494 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.215151 Aug 24 12:34:35.164351 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 117/242] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:34 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:36.181313 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-efb796b2-66ca-4203-bea4-5dd91977521b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:36.182630 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-efb796b2-66ca-4203-bea4-5dd91977521b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:36.184243 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a11f2dbc-b00a-431d-951c-34b389d9efad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:36.186107 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a11f2dbc-b00a-431d-951c-34b389d9efad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:36.190687 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-efb796b2-66ca-4203-bea4-5dd91977521b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:36.191177 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-efb796b2-66ca-4203-bea4-5dd91977521b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:36.191824 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-efb796b2-66ca-4203-bea4-5dd91977521b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:36.192558 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-efb796b2-66ca-4203-bea4-5dd91977521b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:36.192674 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a11f2dbc-b00a-431d-951c-34b389d9efad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:36.193013 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-efb796b2-66ca-4203-bea4-5dd91977521b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:36.193160 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a11f2dbc-b00a-431d-951c-34b389d9efad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:36.193460 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-efb796b2-66ca-4203-bea4-5dd91977521b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:36.193592 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a11f2dbc-b00a-431d-951c-34b389d9efad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:36.194282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a11f2dbc-b00a-431d-951c-34b389d9efad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:36.194731 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a11f2dbc-b00a-431d-951c-34b389d9efad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:36.195149 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a11f2dbc-b00a-431d-951c-34b389d9efad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:36.345982 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a11f2dbc-b00a-431d-951c-34b389d9efad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:36.354006 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a11f2dbc-b00a-431d-951c-34b389d9efad tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.174441 Aug 24 12:34:36.354578 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 118/243] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:36 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:36.472665 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-efb796b2-66ca-4203-bea4-5dd91977521b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:36.477369 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:36.484897 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-efb796b2-66ca-4203-bea4-5dd91977521b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:36.486398 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-efb796b2-66ca-4203-bea4-5dd91977521b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:36.487555 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-efb796b2-66ca-4203-bea4-5dd91977521b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.310857 Aug 24 12:34:36.488126 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 126/244] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:36 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:34:37.375964 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-45c2b4e3-f0dc-4592-90e7-dd8db41fe1f1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:37.376604 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-45c2b4e3-f0dc-4592-90e7-dd8db41fe1f1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:37.383570 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-45c2b4e3-f0dc-4592-90e7-dd8db41fe1f1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:37.385156 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-45c2b4e3-f0dc-4592-90e7-dd8db41fe1f1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:37.385156 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-45c2b4e3-f0dc-4592-90e7-dd8db41fe1f1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:37.385582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-45c2b4e3-f0dc-4592-90e7-dd8db41fe1f1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:37.385738 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-45c2b4e3-f0dc-4592-90e7-dd8db41fe1f1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:37.386072 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-45c2b4e3-f0dc-4592-90e7-dd8db41fe1f1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:37.510137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-915c4642-a7a6-49c6-8a08-ccc8583e2d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:37.510742 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-915c4642-a7a6-49c6-8a08-ccc8583e2d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:37.515891 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:37.520721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-915c4642-a7a6-49c6-8a08-ccc8583e2d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:37.521391 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-915c4642-a7a6-49c6-8a08-ccc8583e2d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:37.525571 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-915c4642-a7a6-49c6-8a08-ccc8583e2d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:37.526486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-915c4642-a7a6-49c6-8a08-ccc8583e2d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:37.527107 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-915c4642-a7a6-49c6-8a08-ccc8583e2d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:37.527917 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-915c4642-a7a6-49c6-8a08-ccc8583e2d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:37.651953 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-45c2b4e3-f0dc-4592-90e7-dd8db41fe1f1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:37.663526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-45c2b4e3-f0dc-4592-90e7-dd8db41fe1f1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.291219 Aug 24 12:34:37.664801 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 119/245] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:37 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:37.715869 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-915c4642-a7a6-49c6-8a08-ccc8583e2d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:37.726594 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-915c4642-a7a6-49c6-8a08-ccc8583e2d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:37.728209 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-915c4642-a7a6-49c6-8a08-ccc8583e2d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:37.729476 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-915c4642-a7a6-49c6-8a08-ccc8583e2d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.223088 Aug 24 12:34:37.730084 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 127/246] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:37 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:34:38.684866 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a75187ee-0852-4719-896d-361220bf9ef9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:38.686108 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a75187ee-0852-4719-896d-361220bf9ef9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:38.692742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a75187ee-0852-4719-896d-361220bf9ef9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:38.693234 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a75187ee-0852-4719-896d-361220bf9ef9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:38.693680 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a75187ee-0852-4719-896d-361220bf9ef9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:38.694420 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a75187ee-0852-4719-896d-361220bf9ef9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:38.694878 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a75187ee-0852-4719-896d-361220bf9ef9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:38.695307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a75187ee-0852-4719-896d-361220bf9ef9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:38.754561 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-47afec0c-d6c0-46e0-b6bc-3a4e9562fa38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:38.755257 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-47afec0c-d6c0-46e0-b6bc-3a4e9562fa38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:38.761501 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-47afec0c-d6c0-46e0-b6bc-3a4e9562fa38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:38.762015 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-47afec0c-d6c0-46e0-b6bc-3a4e9562fa38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:38.762455 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-47afec0c-d6c0-46e0-b6bc-3a4e9562fa38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:38.763148 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-47afec0c-d6c0-46e0-b6bc-3a4e9562fa38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:38.764554 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-47afec0c-d6c0-46e0-b6bc-3a4e9562fa38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:38.764995 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-47afec0c-d6c0-46e0-b6bc-3a4e9562fa38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:38.897981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a75187ee-0852-4719-896d-361220bf9ef9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:38.911193 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a75187ee-0852-4719-896d-361220bf9ef9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1502 microversion: 2.1 time: 0.229643 Aug 24 12:34:38.912620 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 120/247] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:38 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1502 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:38.935160 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-da64e394-b1c0-4382-ae0d-03afe6c184ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Action: 'create', calling method: .version_select at 0x7f46977213a0>, body: {"keypair": {"name": "tempest-keypair-665338024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjSxsdDIQETd2D6kmK2MxjWlvR/qFOEQ3KwyCoJ081Kk4Jpq0dXYEUpc87wPeSF46Now3c3GDMfsLlZJEym19rAmbY6dIaRJb1sh9Nx6YQmgMGJb3R6qhKgi+tpJFs0yg=="}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:38.956311 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-da64e394-b1c0-4382-ae0d-03afe6c184ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for project f3a2fec602684ab1a454b8da589b4787. Resources: {'key_pairs'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:34:38.961330 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-da64e394-b1c0-4382-ae0d-03afe6c184ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for user 9aa753d1e2c4430498d5b28f0304952f and project f3a2fec602684ab1a454b8da589b4787. Resources: {'key_pairs'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:34:38.964696 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-47afec0c-d6c0-46e0-b6bc-3a4e9562fa38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:38.977364 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-47afec0c-d6c0-46e0-b6bc-3a4e9562fa38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:38.979241 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-47afec0c-d6c0-46e0-b6bc-3a4e9562fa38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:38.982016 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-47afec0c-d6c0-46e0-b6bc-3a4e9562fa38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.230875 Aug 24 12:34:38.983009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 128/248] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:38 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:34:38.988475 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-47fd0401-4068-483b-b497-a29426baab97 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "466f6c42-9bc8-471b-9229-9fe0b236a7f1"}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:38.990875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-47fd0401-4068-483b-b497-a29426baab97 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:38.997643 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-47fd0401-4068-483b-b497-a29426baab97 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:38.999023 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-47fd0401-4068-483b-b497-a29426baab97 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:38.999576 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-47fd0401-4068-483b-b497-a29426baab97 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:39.000365 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-47fd0401-4068-483b-b497-a29426baab97 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:39.001205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-47fd0401-4068-483b-b497-a29426baab97 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:39.001671 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-47fd0401-4068-483b-b497-a29426baab97 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:39.003456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-da64e394-b1c0-4382-ae0d-03afe6c184ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078088 Aug 24 12:34:39.004355 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 121/249] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 12:34:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:39.028834 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-47fd0401-4068-483b-b497-a29426baab97 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] HTTP exception thrown: Cannot 'attach_volume' instance a3027685-43d2-43dc-92d2-ac44b036c061 while it is in vm_state rescued Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-47fd0401-4068-483b-b497-a29426baab97 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Request method failure captured: Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: POST /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061/os-volume_attachments HTTP/1.1 Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 74 Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhptNH4mn2TVQcU78gzQc_MEi0EjKa375myyVyDI0kkHg9_so0vJnb2xQ2TdCUf0V4s8LQu4JeSt7iwuhXjPBZKJOkVhmKBO25mKo4XuZDYED7arR8J9UwMqw0S3d9pXZhfromF_FuF00GG74qKZE1M9iai6jJhDaaYLQDZCCnQB9j8 Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 9afa0216c9e140bb82f56f14ccfb7bb6 Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1748371241 Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:34:39.031092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:34:39.032592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:34:39.032592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1748371241 Aug 24 12:34:39.032592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 9afa0216c9e140bb82f56f14ccfb7bb6 Aug 24 12:34:39.032592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1748371241 Aug 24 12:34:39.032592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-ServerRescueNegativeTestJSON-1748371241-project Aug 24 12:34:39.032592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:34:39.032592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:34:39.032592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 9138ac21bbdb4577a7f43b5ab471d572 Aug 24 12:34:39.032592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1748371241-project Aug 24 12:34:39.032592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Aug 24 12:34:39.032592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {"volumeAttachment": {"volumeId": "466f6c42-9bc8-471b-9229-9fe0b236a7f1"}} Aug 24 12:34:39.032592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Cannot 'attach_volume' instance a3027685-43d2-43dc-92d2-ac44b036c061 while it is in vm_state rescued Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'server_id': 'a3027685-43d2-43dc-92d2-ac44b036c061', 'body': {'volumeAttachment': {'volumeId': '466f6c42-9bc8-471b-9229-9fe0b236a7f1'}}} Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a3027685-43d2-43dc-92d2-ac44b036c061 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:34:39.033688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a3027685-43d2-43dc-92d2-ac44b036c061 while it is in vm_state rescued Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:39.034999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:39.036209 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:34:39.036209 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:34:39.036209 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a3027685-43d2-43dc-92d2-ac44b036c061 while it is in vm_state rescued Aug 24 12:34:39.036209 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:34:39.036209 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-47fd0401-4068-483b-b497-a29426baab97 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Returning 409 to user: Cannot 'attach_volume' instance a3027685-43d2-43dc-92d2-ac44b036c061 while it is in vm_state rescued {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:34:39.036209 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-47fd0401-4068-483b-b497-a29426baab97 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "POST /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048223 Aug 24 12:34:39.036209 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 129/250] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 12:34:38 2022] POST /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 12:34:39.043007 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-1e4a3dda-51dd-4a2c-b478-700fc5111e52 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:39.043567 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-1e4a3dda-51dd-4a2c-b478-700fc5111e52 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:39.050336 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1e4a3dda-51dd-4a2c-b478-700fc5111e52 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:39.050837 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1e4a3dda-51dd-4a2c-b478-700fc5111e52 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:39.051272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1e4a3dda-51dd-4a2c-b478-700fc5111e52 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:39.052348 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1e4a3dda-51dd-4a2c-b478-700fc5111e52 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:39.053017 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1e4a3dda-51dd-4a2c-b478-700fc5111e52 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:39.053649 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1e4a3dda-51dd-4a2c-b478-700fc5111e52 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:39.131996 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-1e4a3dda-51dd-4a2c-b478-700fc5111e52 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "POST /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061/action" status: 202 len: 0 microversion: 2.1 time: 0.092669 Aug 24 12:34:39.133158 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 122/251] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 12:34:39 2022] POST /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:34:39.144113 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d844c81f-8329-4afe-a801-b2139961a47c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:39.145077 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d844c81f-8329-4afe-a801-b2139961a47c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:39.151152 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d844c81f-8329-4afe-a801-b2139961a47c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:39.151652 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d844c81f-8329-4afe-a801-b2139961a47c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:39.152246 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d844c81f-8329-4afe-a801-b2139961a47c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:39.153092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d844c81f-8329-4afe-a801-b2139961a47c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:39.153701 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d844c81f-8329-4afe-a801-b2139961a47c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:39.154147 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d844c81f-8329-4afe-a801-b2139961a47c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:39.295197 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d844c81f-8329-4afe-a801-b2139961a47c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:39.305294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d844c81f-8329-4afe-a801-b2139961a47c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1510 microversion: 2.1 time: 0.165588 Aug 24 12:34:39.306029 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 130/252] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:39 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:40.006863 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ee2e408b-9f11-41ae-aa93-5d8478dbd8f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:40.007638 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ee2e408b-9f11-41ae-aa93-5d8478dbd8f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:40.014776 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ee2e408b-9f11-41ae-aa93-5d8478dbd8f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:40.015415 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ee2e408b-9f11-41ae-aa93-5d8478dbd8f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:40.015933 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ee2e408b-9f11-41ae-aa93-5d8478dbd8f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:40.016643 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ee2e408b-9f11-41ae-aa93-5d8478dbd8f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:40.017104 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ee2e408b-9f11-41ae-aa93-5d8478dbd8f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:40.017535 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ee2e408b-9f11-41ae-aa93-5d8478dbd8f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:40.207464 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ee2e408b-9f11-41ae-aa93-5d8478dbd8f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:40.215693 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ee2e408b-9f11-41ae-aa93-5d8478dbd8f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:40.218799 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ee2e408b-9f11-41ae-aa93-5d8478dbd8f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:40.220217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ee2e408b-9f11-41ae-aa93-5d8478dbd8f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.218292 Aug 24 12:34:40.220774 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 123/253] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:40 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:40.328290 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-94d127f1-8dd0-4566-917b-c18aae13e518 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:40.328827 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-94d127f1-8dd0-4566-917b-c18aae13e518 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:40.331156 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=4 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:40.336557 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-94d127f1-8dd0-4566-917b-c18aae13e518 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:40.337186 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-94d127f1-8dd0-4566-917b-c18aae13e518 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:40.337623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-94d127f1-8dd0-4566-917b-c18aae13e518 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:40.338311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-94d127f1-8dd0-4566-917b-c18aae13e518 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:40.338760 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-94d127f1-8dd0-4566-917b-c18aae13e518 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:40.339179 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-94d127f1-8dd0-4566-917b-c18aae13e518 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:40.515086 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-94d127f1-8dd0-4566-917b-c18aae13e518 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:40.523658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-94d127f1-8dd0-4566-917b-c18aae13e518 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1510 microversion: 2.1 time: 0.201237 Aug 24 12:34:40.524776 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 131/254] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:40 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:40.965062 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1576820630", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6afd549-e037-4fe8-8751-48a00c7127d1"}], "security_groups": [{"name": "tempest-securitygroup--397118877"}], "key_name": "tempest-keypair-665338024", "user_data": "}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:41.242460 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-8e774bc1-1aa4-494d-8399-b2f3bd2f83b4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:41.243072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-8e774bc1-1aa4-494d-8399-b2f3bd2f83b4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:41.249174 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8e774bc1-1aa4-494d-8399-b2f3bd2f83b4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:41.249657 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8e774bc1-1aa4-494d-8399-b2f3bd2f83b4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:41.250087 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8e774bc1-1aa4-494d-8399-b2f3bd2f83b4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:41.250776 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8e774bc1-1aa4-494d-8399-b2f3bd2f83b4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:41.251224 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8e774bc1-1aa4-494d-8399-b2f3bd2f83b4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:41.251722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8e774bc1-1aa4-494d-8399-b2f3bd2f83b4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:41.392758 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-8e774bc1-1aa4-494d-8399-b2f3bd2f83b4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:41.401205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-8e774bc1-1aa4-494d-8399-b2f3bd2f83b4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:41.402684 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-8e774bc1-1aa4-494d-8399-b2f3bd2f83b4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:41.403882 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-8e774bc1-1aa4-494d-8399-b2f3bd2f83b4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.165437 Aug 24 12:34:41.405592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 132/255] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:41 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:41.544803 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-8d723df7-ad49-4774-8b2e-800bf27a8781 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:41.545401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-8d723df7-ad49-4774-8b2e-800bf27a8781 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:41.551187 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8d723df7-ad49-4774-8b2e-800bf27a8781 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:41.551691 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8d723df7-ad49-4774-8b2e-800bf27a8781 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:41.552120 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8d723df7-ad49-4774-8b2e-800bf27a8781 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:41.552811 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8d723df7-ad49-4774-8b2e-800bf27a8781 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:41.553244 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8d723df7-ad49-4774-8b2e-800bf27a8781 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:41.553659 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8d723df7-ad49-4774-8b2e-800bf27a8781 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:41.691334 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-8d723df7-ad49-4774-8b2e-800bf27a8781 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:41.698936 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-8d723df7-ad49-4774-8b2e-800bf27a8781 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1510 microversion: 2.1 time: 0.157969 Aug 24 12:34:41.699525 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 133/256] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:41 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:42.360841 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.network.neutron [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] validate_networks() for [('a6afd549-e037-4fe8-8751-48a00c7127d1', None, None, None, None, None)] {{(pid=127307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:34:42.429711 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9248bb58-63c0-43ef-9045-269e96774a1e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:42.430883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9248bb58-63c0-43ef-9045-269e96774a1e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:42.443394 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9248bb58-63c0-43ef-9045-269e96774a1e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:42.444033 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9248bb58-63c0-43ef-9045-269e96774a1e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:42.444856 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9248bb58-63c0-43ef-9045-269e96774a1e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:42.446385 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9248bb58-63c0-43ef-9045-269e96774a1e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:42.447664 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9248bb58-63c0-43ef-9045-269e96774a1e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:42.448096 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9248bb58-63c0-43ef-9045-269e96774a1e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:42.658978 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9248bb58-63c0-43ef-9045-269e96774a1e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:42.669412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9248bb58-63c0-43ef-9045-269e96774a1e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:42.673107 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9248bb58-63c0-43ef-9045-269e96774a1e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:42.676284 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9248bb58-63c0-43ef-9045-269e96774a1e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.251476 Aug 24 12:34:42.676848 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 134/257] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:42 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:34:42.728486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-898ea418-7cba-4d7b-b68c-eab0569838fa tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:42.729509 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-898ea418-7cba-4d7b-b68c-eab0569838fa tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:42.741142 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-898ea418-7cba-4d7b-b68c-eab0569838fa tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:42.742124 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-898ea418-7cba-4d7b-b68c-eab0569838fa tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:42.743291 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-898ea418-7cba-4d7b-b68c-eab0569838fa tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:42.744756 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-898ea418-7cba-4d7b-b68c-eab0569838fa tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:42.745434 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-898ea418-7cba-4d7b-b68c-eab0569838fa tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:42.746194 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-898ea418-7cba-4d7b-b68c-eab0569838fa tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:42.927013 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Flavor limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:34:42.927805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Image limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:34:42.928511 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Flavor pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:34:42.929131 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Image pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:34:42.929782 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:34:42.947930 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:42.948444 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:42.948883 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:42.949830 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:42.950451 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:42.952186 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:42.970246 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-898ea418-7cba-4d7b-b68c-eab0569838fa tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:42.980830 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for project f3a2fec602684ab1a454b8da589b4787. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:34:42.983027 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-898ea418-7cba-4d7b-b68c-eab0569838fa tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1516 microversion: 2.1 time: 0.263814 Aug 24 12:34:42.984593 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 135/258] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:42 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1516 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:42.986638 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for user 9aa753d1e2c4430498d5b28f0304952f and project f3a2fec602684ab1a454b8da589b4787. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:34:43.002164 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Going to run 1 instances... {{(pid=127307) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:34:43.005133 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:34:43.068823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0044bf89-4068-45e5-bd40-b2cd4f0939ff tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.106831 Aug 24 12:34:43.075538 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 124/259] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:34:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 2112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:34:43.085910 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a688c1da-b855-43d2-8255-898d5dc309aa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:43.087487 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-a688c1da-b855-43d2-8255-898d5dc309aa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:43.147794 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-a688c1da-b855-43d2-8255-898d5dc309aa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:43.156882 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a688c1da-b855-43d2-8255-898d5dc309aa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1241 microversion: 2.1 time: 0.079012 Aug 24 12:34:43.167741 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 136/260] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:43 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:43.700010 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-1ab1f1b1-932f-4035-8931-8f657974b6af tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:43.700618 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-1ab1f1b1-932f-4035-8931-8f657974b6af tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:43.707812 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1ab1f1b1-932f-4035-8931-8f657974b6af tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:43.708303 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1ab1f1b1-932f-4035-8931-8f657974b6af tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:43.708743 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1ab1f1b1-932f-4035-8931-8f657974b6af tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.709443 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1ab1f1b1-932f-4035-8931-8f657974b6af tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:43.709912 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1ab1f1b1-932f-4035-8931-8f657974b6af tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:43.710327 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1ab1f1b1-932f-4035-8931-8f657974b6af tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.848898 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-1ab1f1b1-932f-4035-8931-8f657974b6af tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:43.857811 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-1ab1f1b1-932f-4035-8931-8f657974b6af tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:43.859327 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-1ab1f1b1-932f-4035-8931-8f657974b6af tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:43.860524 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-1ab1f1b1-932f-4035-8931-8f657974b6af tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.164688 Aug 24 12:34:43.861082 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 125/261] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:43 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:44.178205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1e9aa9d7-cecc-48b8-a8ab-2d6540bf482d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:44.178815 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1e9aa9d7-cecc-48b8-a8ab-2d6540bf482d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:44.185779 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e9aa9d7-cecc-48b8-a8ab-2d6540bf482d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.187758 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e9aa9d7-cecc-48b8-a8ab-2d6540bf482d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.187758 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e9aa9d7-cecc-48b8-a8ab-2d6540bf482d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:44.188455 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e9aa9d7-cecc-48b8-a8ab-2d6540bf482d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.189093 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e9aa9d7-cecc-48b8-a8ab-2d6540bf482d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.189371 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1e9aa9d7-cecc-48b8-a8ab-2d6540bf482d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:44.253128 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1e9aa9d7-cecc-48b8-a8ab-2d6540bf482d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:44.261938 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1e9aa9d7-cecc-48b8-a8ab-2d6540bf482d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1293 microversion: 2.1 time: 0.087361 Aug 24 12:34:44.262980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 137/262] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:44 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:44.406338 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f7b8608c-598e-4a5d-80d8-bee1a4721621 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Action: 'create', calling method: .version_select at 0x7f46975cd040>, body: {"keypair": {"name": "tempest-keypair-1449660260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwTot7j3huG8kVc715AXMMb7LJlw+2gWcau8V97qple6k7E0QZTJ6VFx7IeTfWSEdVVdzEhUngArMCfhBe5YWQ0/XYe2OuuxwcWfPql6gqKWiW/zFIDEOfwotOIl/N5zQ=="}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:44.423714 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-f7b8608c-598e-4a5d-80d8-bee1a4721621 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Getting quotas for project 9afa0216c9e140bb82f56f14ccfb7bb6. Resources: {'key_pairs'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:34:44.427923 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-f7b8608c-598e-4a5d-80d8-bee1a4721621 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Getting quotas for user 9138ac21bbdb4577a7f43b5ab471d572 and project 9afa0216c9e140bb82f56f14ccfb7bb6. Resources: {'key_pairs'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:34:44.449829 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f7b8608c-598e-4a5d-80d8-bee1a4721621 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047469 Aug 24 12:34:44.450426 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 126/263] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 12:34:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:44.884531 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-88a303b3-deaf-4bf2-ae23-8e4d63d33cf2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:44.885145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-88a303b3-deaf-4bf2-ae23-8e4d63d33cf2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:44.891668 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-88a303b3-deaf-4bf2-ae23-8e4d63d33cf2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.892160 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-88a303b3-deaf-4bf2-ae23-8e4d63d33cf2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.892586 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-88a303b3-deaf-4bf2-ae23-8e4d63d33cf2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:44.893444 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-88a303b3-deaf-4bf2-ae23-8e4d63d33cf2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.893901 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-88a303b3-deaf-4bf2-ae23-8e4d63d33cf2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.894322 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-88a303b3-deaf-4bf2-ae23-8e4d63d33cf2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:45.128076 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-88a303b3-deaf-4bf2-ae23-8e4d63d33cf2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:45.138779 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-88a303b3-deaf-4bf2-ae23-8e4d63d33cf2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:45.140326 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-88a303b3-deaf-4bf2-ae23-8e4d63d33cf2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:45.141597 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-88a303b3-deaf-4bf2-ae23-8e4d63d33cf2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.261101 Aug 24 12:34:45.155660 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 138/264] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:44 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:45.285476 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-519d8ef2-a82b-4bb6-a914-b5df6875b8e5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:45.286803 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-519d8ef2-a82b-4bb6-a914-b5df6875b8e5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:45.293745 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-519d8ef2-a82b-4bb6-a914-b5df6875b8e5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:45.294234 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-519d8ef2-a82b-4bb6-a914-b5df6875b8e5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:45.294703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-519d8ef2-a82b-4bb6-a914-b5df6875b8e5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:45.296010 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-519d8ef2-a82b-4bb6-a914-b5df6875b8e5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:45.296477 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-519d8ef2-a82b-4bb6-a914-b5df6875b8e5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:45.297704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-519d8ef2-a82b-4bb6-a914-b5df6875b8e5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:45.441242 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-519d8ef2-a82b-4bb6-a914-b5df6875b8e5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:45.452611 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-519d8ef2-a82b-4bb6-a914-b5df6875b8e5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1299 microversion: 2.1 time: 0.170512 Aug 24 12:34:45.470529 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 127/265] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:45 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1299 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:45.531465 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-02a1d21c-30b7-448e-8de7-e79c0fe8d83e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:45.540309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-02a1d21c-30b7-448e-8de7-e79c0fe8d83e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:45.540818 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-02a1d21c-30b7-448e-8de7-e79c0fe8d83e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:45.541312 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-02a1d21c-30b7-448e-8de7-e79c0fe8d83e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:45.622074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-02a1d21c-30b7-448e-8de7-e79c0fe8d83e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Going to try to stop instance {{(pid=127308) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 12:34:45.685021 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-02a1d21c-30b7-448e-8de7-e79c0fe8d83e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "POST /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/action" status: 202 len: 0 microversion: 2.1 time: 0.158427 Aug 24 12:34:45.686635 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 139/266] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 12:34:45 2022] POST /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:34:45.696544 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a60b4657-53b0-456e-a1f4-2972066dff75 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:45.697786 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a60b4657-53b0-456e-a1f4-2972066dff75 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:45.709339 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a60b4657-53b0-456e-a1f4-2972066dff75 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:45.710180 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a60b4657-53b0-456e-a1f4-2972066dff75 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:45.710960 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a60b4657-53b0-456e-a1f4-2972066dff75 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:45.712137 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a60b4657-53b0-456e-a1f4-2972066dff75 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:45.713058 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a60b4657-53b0-456e-a1f4-2972066dff75 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:45.713719 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a60b4657-53b0-456e-a1f4-2972066dff75 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:46.003133 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a60b4657-53b0-456e-a1f4-2972066dff75 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:46.021677 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:46.026144 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a60b4657-53b0-456e-a1f4-2972066dff75 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.334882 Aug 24 12:34:46.027113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 128/267] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:45 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:46.175814 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9701e314-c693-431f-b508-bfe737d18d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:46.177075 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9701e314-c693-431f-b508-bfe737d18d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:46.200034 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9701e314-c693-431f-b508-bfe737d18d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:46.201393 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9701e314-c693-431f-b508-bfe737d18d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:46.202862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9701e314-c693-431f-b508-bfe737d18d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:46.204405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9701e314-c693-431f-b508-bfe737d18d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:46.205281 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9701e314-c693-431f-b508-bfe737d18d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:46.206088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9701e314-c693-431f-b508-bfe737d18d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:46.285292 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-521168068", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2dc0cfb6-341d-429c-9c42-4b53f3cb8f09"}], "security_groups": [{"name": "tempest-securitygroup--938435489"}], "key_name": "tempest-keypair-1449660260", "user_data": "}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:46.448907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9701e314-c693-431f-b508-bfe737d18d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:46.454679 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.network.neutron [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] validate_networks() for [('2dc0cfb6-341d-429c-9c42-4b53f3cb8f09', None, None, None, None, None)] {{(pid=127307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:34:46.458972 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9701e314-c693-431f-b508-bfe737d18d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:46.460911 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9701e314-c693-431f-b508-bfe737d18d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:46.462236 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9701e314-c693-431f-b508-bfe737d18d0c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.292945 Aug 24 12:34:46.462929 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 140/268] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:46 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:46.481200 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-8e9fea52-38b2-4c8b-82f0-2fc8bc678eb0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:46.482907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-8e9fea52-38b2-4c8b-82f0-2fc8bc678eb0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:46.490253 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8e9fea52-38b2-4c8b-82f0-2fc8bc678eb0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:46.491032 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8e9fea52-38b2-4c8b-82f0-2fc8bc678eb0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:46.491490 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8e9fea52-38b2-4c8b-82f0-2fc8bc678eb0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:46.492401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8e9fea52-38b2-4c8b-82f0-2fc8bc678eb0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:46.494121 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8e9fea52-38b2-4c8b-82f0-2fc8bc678eb0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:46.495008 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8e9fea52-38b2-4c8b-82f0-2fc8bc678eb0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:46.725133 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-8e9fea52-38b2-4c8b-82f0-2fc8bc678eb0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:46.733602 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-8e9fea52-38b2-4c8b-82f0-2fc8bc678eb0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1366 microversion: 2.1 time: 0.258239 Aug 24 12:34:46.734516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 141/269] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:46 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:46.741014 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-2d60cb28-1a19-43b2-bec4-5702b4ce771d req-2bf2712a-0598-4a91-98e6-43a94a037e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a53b53-99f8-423a-b3f2-67416a5a323b", "tag": "cdff0ddd-8433-4eb5-8cd3-028ce16cd9b3"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:46.753386 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-2d60cb28-1a19-43b2-bec4-5702b4ce771d req-2bf2712a-0598-4a91-98e6-43a94a037e4f service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:46.753865 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-2d60cb28-1a19-43b2-bec4-5702b4ce771d req-2bf2712a-0598-4a91-98e6-43a94a037e4f service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:46.754292 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-2d60cb28-1a19-43b2-bec4-5702b4ce771d req-2bf2712a-0598-4a91-98e6-43a94a037e4f service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:46.770551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-2d60cb28-1a19-43b2-bec4-5702b4ce771d req-2bf2712a-0598-4a91-98e6-43a94a037e4f service nova] Creating event network-changed:cdff0ddd-8433-4eb5-8cd3-028ce16cd9b3 for instance 32a53b53-99f8-423a-b3f2-67416a5a323b on hv-cinder-84890 Aug 24 12:34:46.776403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-2d60cb28-1a19-43b2-bec4-5702b4ce771d req-2bf2712a-0598-4a91-98e6-43a94a037e4f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040540 Aug 24 12:34:46.777075 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 142/270] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:46.969315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Flavor limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:34:46.969744 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Image limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:34:46.970222 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Flavor pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:34:46.970688 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Image pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:34:46.971099 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:34:46.979849 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:46.980333 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:46.980772 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:46.981495 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:46.981953 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:46.982377 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:46.999050 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Getting quotas for project 9afa0216c9e140bb82f56f14ccfb7bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:34:47.003088 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Getting quotas for user 9138ac21bbdb4577a7f43b5ab471d572 and project 9afa0216c9e140bb82f56f14ccfb7bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:34:47.014853 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Going to run 1 instances... {{(pid=127307) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:34:47.017052 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:34:47.056564 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-84176882-1c12-4905-b31a-a50ebd9b9cc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:47.058428 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-84176882-1c12-4905-b31a-a50ebd9b9cc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:47.068232 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-84176882-1c12-4905-b31a-a50ebd9b9cc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:47.069173 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-84176882-1c12-4905-b31a-a50ebd9b9cc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:47.069980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-84176882-1c12-4905-b31a-a50ebd9b9cc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:47.071003 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-84176882-1c12-4905-b31a-a50ebd9b9cc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:47.071557 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-84176882-1c12-4905-b31a-a50ebd9b9cc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:47.072107 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-84176882-1c12-4905-b31a-a50ebd9b9cc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:47.089550 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3c4145cd-6fdc-4fe0-8b97-408ca457a8d8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.819768 Aug 24 12:34:47.090708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 129/271] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:34:46 2022] POST /compute/v2.1/servers => generated 408 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:34:47.101079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f2cd627e-1bd8-44d7-ae23-4f2e2a57adb6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:47.101959 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f2cd627e-1bd8-44d7-ae23-4f2e2a57adb6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:47.212792 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f2cd627e-1bd8-44d7-ae23-4f2e2a57adb6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:47.220284 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f2cd627e-1bd8-44d7-ae23-4f2e2a57adb6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1245 microversion: 2.1 time: 0.122943 Aug 24 12:34:47.221547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 130/272] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:47 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1245 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:47.253109 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-84176882-1c12-4905-b31a-a50ebd9b9cc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:47.262379 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-84176882-1c12-4905-b31a-a50ebd9b9cc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.212303 Aug 24 12:34:47.263919 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 143/273] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:47 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:47.487391 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c0e16e44-5442-4fef-9bb1-f4ce5a44a1c8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:47.488168 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c0e16e44-5442-4fef-9bb1-f4ce5a44a1c8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:47.494953 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0e16e44-5442-4fef-9bb1-f4ce5a44a1c8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:47.495486 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0e16e44-5442-4fef-9bb1-f4ce5a44a1c8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:47.496052 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0e16e44-5442-4fef-9bb1-f4ce5a44a1c8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:47.496671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0e16e44-5442-4fef-9bb1-f4ce5a44a1c8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:47.497156 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0e16e44-5442-4fef-9bb1-f4ce5a44a1c8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:47.498182 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0e16e44-5442-4fef-9bb1-f4ce5a44a1c8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:47.629838 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c0e16e44-5442-4fef-9bb1-f4ce5a44a1c8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:47.638833 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c0e16e44-5442-4fef-9bb1-f4ce5a44a1c8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:47.640393 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c0e16e44-5442-4fef-9bb1-f4ce5a44a1c8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:47.641615 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c0e16e44-5442-4fef-9bb1-f4ce5a44a1c8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.158545 Aug 24 12:34:47.642185 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 131/274] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:47 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:47.754827 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-8c55305c-5f71-4825-a492-0848bd0913a9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:47.755398 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-8c55305c-5f71-4825-a492-0848bd0913a9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:47.761768 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8c55305c-5f71-4825-a492-0848bd0913a9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:47.762246 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8c55305c-5f71-4825-a492-0848bd0913a9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:47.762674 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8c55305c-5f71-4825-a492-0848bd0913a9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:47.763420 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8c55305c-5f71-4825-a492-0848bd0913a9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:47.763903 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8c55305c-5f71-4825-a492-0848bd0913a9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:47.764318 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8c55305c-5f71-4825-a492-0848bd0913a9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:47.782182 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:47.896892 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-8c55305c-5f71-4825-a492-0848bd0913a9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:47.905109 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-8c55305c-5f71-4825-a492-0848bd0913a9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1366 microversion: 2.1 time: 0.154195 Aug 24 12:34:47.905678 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 144/275] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:47 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:48.242327 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-1483eb75-cdf7-4ba0-a48c-1f053ab3aabb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:48.242936 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-1483eb75-cdf7-4ba0-a48c-1f053ab3aabb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:48.248851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1483eb75-cdf7-4ba0-a48c-1f053ab3aabb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:48.249327 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1483eb75-cdf7-4ba0-a48c-1f053ab3aabb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:48.249788 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1483eb75-cdf7-4ba0-a48c-1f053ab3aabb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:48.250502 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1483eb75-cdf7-4ba0-a48c-1f053ab3aabb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:48.251015 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1483eb75-cdf7-4ba0-a48c-1f053ab3aabb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:48.251437 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1483eb75-cdf7-4ba0-a48c-1f053ab3aabb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:48.286836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-35560433-2e9c-4416-a98f-5c9b5a8baf27 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:48.287576 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-35560433-2e9c-4416-a98f-5c9b5a8baf27 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:48.296579 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-35560433-2e9c-4416-a98f-5c9b5a8baf27 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:48.298569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-35560433-2e9c-4416-a98f-5c9b5a8baf27 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:48.299199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-35560433-2e9c-4416-a98f-5c9b5a8baf27 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:48.300979 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-35560433-2e9c-4416-a98f-5c9b5a8baf27 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:48.301446 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-35560433-2e9c-4416-a98f-5c9b5a8baf27 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:48.301872 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-35560433-2e9c-4416-a98f-5c9b5a8baf27 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:48.319540 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-1483eb75-cdf7-4ba0-a48c-1f053ab3aabb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:48.333036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-1483eb75-cdf7-4ba0-a48c-1f053ab3aabb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1249 microversion: 2.1 time: 0.094386 Aug 24 12:34:48.333723 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 132/276] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:48 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:48.446896 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-35560433-2e9c-4416-a98f-5c9b5a8baf27 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:48.455814 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-35560433-2e9c-4416-a98f-5c9b5a8baf27 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.173245 Aug 24 12:34:48.456374 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 145/277] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:48 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:48.665007 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-33a8cb07-b95a-46bc-87d7-ebc15ea46a2f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:48.665706 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-33a8cb07-b95a-46bc-87d7-ebc15ea46a2f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:48.675264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-33a8cb07-b95a-46bc-87d7-ebc15ea46a2f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:48.675264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-33a8cb07-b95a-46bc-87d7-ebc15ea46a2f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:48.675682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-33a8cb07-b95a-46bc-87d7-ebc15ea46a2f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:48.676711 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-33a8cb07-b95a-46bc-87d7-ebc15ea46a2f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:48.677011 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-33a8cb07-b95a-46bc-87d7-ebc15ea46a2f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:48.677444 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-33a8cb07-b95a-46bc-87d7-ebc15ea46a2f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:48.862683 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-33a8cb07-b95a-46bc-87d7-ebc15ea46a2f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:48.884673 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-33a8cb07-b95a-46bc-87d7-ebc15ea46a2f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:48.886575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-33a8cb07-b95a-46bc-87d7-ebc15ea46a2f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:48.887814 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-33a8cb07-b95a-46bc-87d7-ebc15ea46a2f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.227523 Aug 24 12:34:48.888935 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 133/278] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:48 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:48.928675 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-11d9fb09-57e3-453d-9716-530e73cdbce1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:48.929270 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-11d9fb09-57e3-453d-9716-530e73cdbce1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:48.942895 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-11d9fb09-57e3-453d-9716-530e73cdbce1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:48.943454 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-11d9fb09-57e3-453d-9716-530e73cdbce1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:48.943946 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-11d9fb09-57e3-453d-9716-530e73cdbce1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:48.944909 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-11d9fb09-57e3-453d-9716-530e73cdbce1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:48.945365 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-11d9fb09-57e3-453d-9716-530e73cdbce1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:48.945793 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-11d9fb09-57e3-453d-9716-530e73cdbce1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:49.099553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-11d9fb09-57e3-453d-9716-530e73cdbce1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:49.108129 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-11d9fb09-57e3-453d-9716-530e73cdbce1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1366 microversion: 2.1 time: 0.183128 Aug 24 12:34:49.108684 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 146/279] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:48 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:49.354406 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-fee89955-9617-455d-9852-0f77e030c7cc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:49.355013 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-fee89955-9617-455d-9852-0f77e030c7cc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:49.361922 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fee89955-9617-455d-9852-0f77e030c7cc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:49.362413 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fee89955-9617-455d-9852-0f77e030c7cc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:49.362855 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fee89955-9617-455d-9852-0f77e030c7cc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:49.363587 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fee89955-9617-455d-9852-0f77e030c7cc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:49.364069 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fee89955-9617-455d-9852-0f77e030c7cc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:49.364497 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fee89955-9617-455d-9852-0f77e030c7cc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:49.434185 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-fee89955-9617-455d-9852-0f77e030c7cc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:49.443392 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-fee89955-9617-455d-9852-0f77e030c7cc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1297 microversion: 2.1 time: 0.093491 Aug 24 12:34:49.444001 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 134/280] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:49 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:49.478764 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-59b12d83-e59d-4062-b38a-49656e5a3823 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:49.479425 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-59b12d83-e59d-4062-b38a-49656e5a3823 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:49.486796 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59b12d83-e59d-4062-b38a-49656e5a3823 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:49.487417 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59b12d83-e59d-4062-b38a-49656e5a3823 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:49.488034 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59b12d83-e59d-4062-b38a-49656e5a3823 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:49.488727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59b12d83-e59d-4062-b38a-49656e5a3823 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:49.489176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59b12d83-e59d-4062-b38a-49656e5a3823 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:49.489787 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59b12d83-e59d-4062-b38a-49656e5a3823 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:49.631542 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-59b12d83-e59d-4062-b38a-49656e5a3823 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:49.641984 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-59b12d83-e59d-4062-b38a-49656e5a3823 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.168118 Aug 24 12:34:49.642696 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 147/281] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:49 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:49.911223 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2b472ee7-b5d2-4281-aee8-f33e3c1e29e8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:49.911872 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2b472ee7-b5d2-4281-aee8-f33e3c1e29e8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:49.914174 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:49.920130 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2b472ee7-b5d2-4281-aee8-f33e3c1e29e8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:49.920795 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2b472ee7-b5d2-4281-aee8-f33e3c1e29e8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:49.921239 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2b472ee7-b5d2-4281-aee8-f33e3c1e29e8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:49.921944 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2b472ee7-b5d2-4281-aee8-f33e3c1e29e8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:49.922406 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2b472ee7-b5d2-4281-aee8-f33e3c1e29e8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:49.922835 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2b472ee7-b5d2-4281-aee8-f33e3c1e29e8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:50.052080 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2b472ee7-b5d2-4281-aee8-f33e3c1e29e8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:50.061336 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2b472ee7-b5d2-4281-aee8-f33e3c1e29e8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:50.062845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2b472ee7-b5d2-4281-aee8-f33e3c1e29e8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:50.064068 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2b472ee7-b5d2-4281-aee8-f33e3c1e29e8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1745 microversion: 2.20 time: 0.156666 Aug 24 12:34:50.064631 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 135/282] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:49 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:50.129258 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e158d341-43d9-4b16-b548-bec9e2ad64ee tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:50.129861 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e158d341-43d9-4b16-b548-bec9e2ad64ee tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:50.136613 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e158d341-43d9-4b16-b548-bec9e2ad64ee tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:50.137101 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e158d341-43d9-4b16-b548-bec9e2ad64ee tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:50.137531 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e158d341-43d9-4b16-b548-bec9e2ad64ee tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:50.138233 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e158d341-43d9-4b16-b548-bec9e2ad64ee tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:50.138810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e158d341-43d9-4b16-b548-bec9e2ad64ee tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:50.139234 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e158d341-43d9-4b16-b548-bec9e2ad64ee tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:50.308599 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e158d341-43d9-4b16-b548-bec9e2ad64ee tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:50.314057 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e158d341-43d9-4b16-b548-bec9e2ad64ee tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1366 microversion: 2.1 time: 0.188661 Aug 24 12:34:50.314964 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 148/283] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:50 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:50.465868 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ed8f8991-9474-4347-8ce1-900986869581 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:50.469018 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ed8f8991-9474-4347-8ce1-900986869581 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:50.478465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ed8f8991-9474-4347-8ce1-900986869581 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:50.479232 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ed8f8991-9474-4347-8ce1-900986869581 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:50.480185 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ed8f8991-9474-4347-8ce1-900986869581 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:50.481990 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ed8f8991-9474-4347-8ce1-900986869581 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:50.481990 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ed8f8991-9474-4347-8ce1-900986869581 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:50.482818 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ed8f8991-9474-4347-8ce1-900986869581 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:50.635252 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ed8f8991-9474-4347-8ce1-900986869581 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:50.644194 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ed8f8991-9474-4347-8ce1-900986869581 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1370 microversion: 2.1 time: 0.183514 Aug 24 12:34:50.645062 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 136/284] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:50 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:50.663841 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-53895569-09dc-4f7e-99f3-4188cd259dbb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:50.664476 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-53895569-09dc-4f7e-99f3-4188cd259dbb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:50.671595 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53895569-09dc-4f7e-99f3-4188cd259dbb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:50.672103 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53895569-09dc-4f7e-99f3-4188cd259dbb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:50.672537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53895569-09dc-4f7e-99f3-4188cd259dbb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:50.673225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53895569-09dc-4f7e-99f3-4188cd259dbb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:50.673677 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53895569-09dc-4f7e-99f3-4188cd259dbb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:50.674095 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53895569-09dc-4f7e-99f3-4188cd259dbb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:50.835059 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-53895569-09dc-4f7e-99f3-4188cd259dbb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:50.844599 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-53895569-09dc-4f7e-99f3-4188cd259dbb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.184621 Aug 24 12:34:50.845319 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 149/285] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:50 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:51.087425 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-db05f5e9-6723-4b02-9325-c0148de15a8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:51.088087 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-db05f5e9-6723-4b02-9325-c0148de15a8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:51.094410 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-db05f5e9-6723-4b02-9325-c0148de15a8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:51.094894 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-db05f5e9-6723-4b02-9325-c0148de15a8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:51.095336 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-db05f5e9-6723-4b02-9325-c0148de15a8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:51.096059 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-db05f5e9-6723-4b02-9325-c0148de15a8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:51.096509 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-db05f5e9-6723-4b02-9325-c0148de15a8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:51.096936 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-db05f5e9-6723-4b02-9325-c0148de15a8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:51.163892 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-7b42459d-f7e5-415a-9f1a-6fb4f600f99f req-28a3fce3-fbc9-4110-b408-562236d5bdd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fdcfd7-6650-4fe4-8c3a-746ea58f0409", "tag": "93921963-7c18-4787-bce0-01c4d4b2201a"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:51.182348 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-7b42459d-f7e5-415a-9f1a-6fb4f600f99f req-28a3fce3-fbc9-4110-b408-562236d5bdd5 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:51.183122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-7b42459d-f7e5-415a-9f1a-6fb4f600f99f req-28a3fce3-fbc9-4110-b408-562236d5bdd5 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:51.183820 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-7b42459d-f7e5-415a-9f1a-6fb4f600f99f req-28a3fce3-fbc9-4110-b408-562236d5bdd5 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:51.214849 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-7b42459d-f7e5-415a-9f1a-6fb4f600f99f req-28a3fce3-fbc9-4110-b408-562236d5bdd5 service nova] Creating event network-changed:93921963-7c18-4787-bce0-01c4d4b2201a for instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 on hv-cinder-84890 Aug 24 12:34:51.220817 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-7b42459d-f7e5-415a-9f1a-6fb4f600f99f req-28a3fce3-fbc9-4110-b408-562236d5bdd5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060633 Aug 24 12:34:51.221779 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 150/286] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:51.241095 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-db05f5e9-6723-4b02-9325-c0148de15a8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:51.249889 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-db05f5e9-6723-4b02-9325-c0148de15a8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:51.251425 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-db05f5e9-6723-4b02-9325-c0148de15a8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:51.252619 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-db05f5e9-6723-4b02-9325-c0148de15a8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1745 microversion: 2.20 time: 0.169166 Aug 24 12:34:51.253179 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 137/287] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:51 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:51.335024 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7bfed53e-98fc-493b-8a04-57efbdbc6707 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:51.335782 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-7bfed53e-98fc-493b-8a04-57efbdbc6707 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:51.343252 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7bfed53e-98fc-493b-8a04-57efbdbc6707 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:51.343776 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7bfed53e-98fc-493b-8a04-57efbdbc6707 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:51.344212 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7bfed53e-98fc-493b-8a04-57efbdbc6707 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:51.344915 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7bfed53e-98fc-493b-8a04-57efbdbc6707 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:51.345364 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7bfed53e-98fc-493b-8a04-57efbdbc6707 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:51.345874 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7bfed53e-98fc-493b-8a04-57efbdbc6707 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:51.497217 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-7bfed53e-98fc-493b-8a04-57efbdbc6707 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:51.505515 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-7bfed53e-98fc-493b-8a04-57efbdbc6707 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1366 microversion: 2.1 time: 0.174838 Aug 24 12:34:51.506073 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 151/288] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:51 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:51.666228 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ff5655a9-c8c1-4e00-95e1-1b6caaf44b0b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:51.666878 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ff5655a9-c8c1-4e00-95e1-1b6caaf44b0b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:51.674195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ff5655a9-c8c1-4e00-95e1-1b6caaf44b0b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:51.674697 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ff5655a9-c8c1-4e00-95e1-1b6caaf44b0b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:51.675137 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ff5655a9-c8c1-4e00-95e1-1b6caaf44b0b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:51.675876 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ff5655a9-c8c1-4e00-95e1-1b6caaf44b0b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:51.676338 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ff5655a9-c8c1-4e00-95e1-1b6caaf44b0b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:51.676764 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ff5655a9-c8c1-4e00-95e1-1b6caaf44b0b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:51.803443 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ff5655a9-c8c1-4e00-95e1-1b6caaf44b0b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:51.811799 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ff5655a9-c8c1-4e00-95e1-1b6caaf44b0b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1370 microversion: 2.1 time: 0.149421 Aug 24 12:34:51.812361 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 138/289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:51 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:51.866294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-06c19cb3-17e9-4dff-a1b3-76af7def3e74 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:51.867001 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-06c19cb3-17e9-4dff-a1b3-76af7def3e74 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:51.874766 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-06c19cb3-17e9-4dff-a1b3-76af7def3e74 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:51.874766 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-06c19cb3-17e9-4dff-a1b3-76af7def3e74 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:51.875207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-06c19cb3-17e9-4dff-a1b3-76af7def3e74 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:51.875998 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-06c19cb3-17e9-4dff-a1b3-76af7def3e74 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:51.876401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-06c19cb3-17e9-4dff-a1b3-76af7def3e74 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:51.876822 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-06c19cb3-17e9-4dff-a1b3-76af7def3e74 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:52.006917 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-06c19cb3-17e9-4dff-a1b3-76af7def3e74 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:52.015268 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-06c19cb3-17e9-4dff-a1b3-76af7def3e74 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.152842 Aug 24 12:34:52.015832 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 152/290] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:51 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:52.278087 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c4753bc7-16f9-40cd-9ce9-7f9f1e747da1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:52.278652 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c4753bc7-16f9-40cd-9ce9-7f9f1e747da1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:52.287230 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c4753bc7-16f9-40cd-9ce9-7f9f1e747da1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:52.287884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c4753bc7-16f9-40cd-9ce9-7f9f1e747da1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:52.288689 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c4753bc7-16f9-40cd-9ce9-7f9f1e747da1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:52.289939 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c4753bc7-16f9-40cd-9ce9-7f9f1e747da1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:52.290763 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c4753bc7-16f9-40cd-9ce9-7f9f1e747da1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:52.291252 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c4753bc7-16f9-40cd-9ce9-7f9f1e747da1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:52.424441 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c4753bc7-16f9-40cd-9ce9-7f9f1e747da1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:52.432663 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c4753bc7-16f9-40cd-9ce9-7f9f1e747da1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:52.434455 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c4753bc7-16f9-40cd-9ce9-7f9f1e747da1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:52.435776 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c4753bc7-16f9-40cd-9ce9-7f9f1e747da1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1745 microversion: 2.20 time: 0.161651 Aug 24 12:34:52.436334 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 139/291] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:52 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:52.525994 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9a63c837-e467-4190-aa7f-4fb6528ed389 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:52.526620 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9a63c837-e467-4190-aa7f-4fb6528ed389 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:52.533525 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9a63c837-e467-4190-aa7f-4fb6528ed389 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:52.533943 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9a63c837-e467-4190-aa7f-4fb6528ed389 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:52.534369 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9a63c837-e467-4190-aa7f-4fb6528ed389 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:52.535042 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9a63c837-e467-4190-aa7f-4fb6528ed389 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:52.535481 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9a63c837-e467-4190-aa7f-4fb6528ed389 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:52.535927 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9a63c837-e467-4190-aa7f-4fb6528ed389 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:52.667110 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9a63c837-e467-4190-aa7f-4fb6528ed389 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:52.675569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9a63c837-e467-4190-aa7f-4fb6528ed389 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1366 microversion: 2.1 time: 0.153331 Aug 24 12:34:52.676236 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 153/292] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:52 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:52.832166 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-75447aab-d2ec-4b74-9095-3844e14b05cd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:52.832779 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-75447aab-d2ec-4b74-9095-3844e14b05cd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:52.838735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-75447aab-d2ec-4b74-9095-3844e14b05cd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:52.839222 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-75447aab-d2ec-4b74-9095-3844e14b05cd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:52.839693 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-75447aab-d2ec-4b74-9095-3844e14b05cd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:52.840479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-75447aab-d2ec-4b74-9095-3844e14b05cd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:52.840851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-75447aab-d2ec-4b74-9095-3844e14b05cd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:52.841929 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-75447aab-d2ec-4b74-9095-3844e14b05cd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:53.020887 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-75447aab-d2ec-4b74-9095-3844e14b05cd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:53.038303 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-75447aab-d2ec-4b74-9095-3844e14b05cd tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1370 microversion: 2.1 time: 0.209909 Aug 24 12:34:53.039916 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-666bfb96-805e-4f12-87f7-6d7f0d4cc362 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:53.041120 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 140/293] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:52 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:53.041297 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-666bfb96-805e-4f12-87f7-6d7f0d4cc362 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:53.048230 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-666bfb96-805e-4f12-87f7-6d7f0d4cc362 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:53.048728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-666bfb96-805e-4f12-87f7-6d7f0d4cc362 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:53.049160 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-666bfb96-805e-4f12-87f7-6d7f0d4cc362 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:53.050247 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-666bfb96-805e-4f12-87f7-6d7f0d4cc362 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:53.050705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-666bfb96-805e-4f12-87f7-6d7f0d4cc362 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:53.051123 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-666bfb96-805e-4f12-87f7-6d7f0d4cc362 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:53.084487 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-cfa88db6-4373-4e7d-b686-40fadb563857 req-c772feba-f656-472a-badf-dc8d48ce4be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a53b53-99f8-423a-b3f2-67416a5a323b", "name": "network-vif-plugged", "status": "completed", "tag": "cdff0ddd-8433-4eb5-8cd3-028ce16cd9b3"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:53.105160 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-cfa88db6-4373-4e7d-b686-40fadb563857 req-c772feba-f656-472a-badf-dc8d48ce4be1 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:53.105841 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-cfa88db6-4373-4e7d-b686-40fadb563857 req-c772feba-f656-472a-badf-dc8d48ce4be1 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:53.106424 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-cfa88db6-4373-4e7d-b686-40fadb563857 req-c772feba-f656-472a-badf-dc8d48ce4be1 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:53.133497 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-cfa88db6-4373-4e7d-b686-40fadb563857 req-c772feba-f656-472a-badf-dc8d48ce4be1 service nova] Creating event network-vif-plugged:cdff0ddd-8433-4eb5-8cd3-028ce16cd9b3 for instance 32a53b53-99f8-423a-b3f2-67416a5a323b on hv-cinder-84890 Aug 24 12:34:53.140067 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-cfa88db6-4373-4e7d-b686-40fadb563857 req-c772feba-f656-472a-badf-dc8d48ce4be1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060132 Aug 24 12:34:53.141229 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 141/294] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:53.153453 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:53.205746 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-666bfb96-805e-4f12-87f7-6d7f0d4cc362 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:53.216316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-666bfb96-805e-4f12-87f7-6d7f0d4cc362 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.182791 Aug 24 12:34:53.219770 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 154/295] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:53 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:53.462500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a51cf061-d6a3-427e-9c81-08e545a08a36 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:53.463216 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a51cf061-d6a3-427e-9c81-08e545a08a36 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:53.470987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a51cf061-d6a3-427e-9c81-08e545a08a36 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:53.471479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a51cf061-d6a3-427e-9c81-08e545a08a36 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:53.471956 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a51cf061-d6a3-427e-9c81-08e545a08a36 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:53.472807 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a51cf061-d6a3-427e-9c81-08e545a08a36 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:53.473267 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a51cf061-d6a3-427e-9c81-08e545a08a36 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:53.474117 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a51cf061-d6a3-427e-9c81-08e545a08a36 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:53.646604 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a51cf061-d6a3-427e-9c81-08e545a08a36 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:53.654842 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a51cf061-d6a3-427e-9c81-08e545a08a36 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:53.656400 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a51cf061-d6a3-427e-9c81-08e545a08a36 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:53.657572 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a51cf061-d6a3-427e-9c81-08e545a08a36 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1740 microversion: 2.20 time: 0.202592 Aug 24 12:34:53.658140 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 142/296] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:53 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:53.696669 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-fb097d2b-32d4-456c-8818-b5dd7c93daef tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:53.697940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-fb097d2b-32d4-456c-8818-b5dd7c93daef tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:53.706024 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb097d2b-32d4-456c-8818-b5dd7c93daef tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:53.706524 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb097d2b-32d4-456c-8818-b5dd7c93daef tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:53.706936 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb097d2b-32d4-456c-8818-b5dd7c93daef tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:53.707641 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb097d2b-32d4-456c-8818-b5dd7c93daef tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:53.708099 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb097d2b-32d4-456c-8818-b5dd7c93daef tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:53.708515 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fb097d2b-32d4-456c-8818-b5dd7c93daef tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:54.063460 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3e330926-ab2b-4d55-923a-9aad6b8a1982 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:54.064479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3e330926-ab2b-4d55-923a-9aad6b8a1982 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:54.071206 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3e330926-ab2b-4d55-923a-9aad6b8a1982 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:54.072100 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3e330926-ab2b-4d55-923a-9aad6b8a1982 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:54.074122 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3e330926-ab2b-4d55-923a-9aad6b8a1982 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:54.075244 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3e330926-ab2b-4d55-923a-9aad6b8a1982 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:54.076340 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3e330926-ab2b-4d55-923a-9aad6b8a1982 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:54.077331 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3e330926-ab2b-4d55-923a-9aad6b8a1982 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:54.220193 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-fb097d2b-32d4-456c-8818-b5dd7c93daef tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:54.238118 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-fb097d2b-32d4-456c-8818-b5dd7c93daef tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1366 microversion: 2.1 time: 0.545066 Aug 24 12:34:54.251647 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 155/297] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:53 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1366 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:54.251647 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-14c24ebb-a725-4867-9be3-51f06c9fbd5d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:54.251647 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-14c24ebb-a725-4867-9be3-51f06c9fbd5d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:54.263499 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-14c24ebb-a725-4867-9be3-51f06c9fbd5d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:54.268831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-14c24ebb-a725-4867-9be3-51f06c9fbd5d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:54.272781 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-14c24ebb-a725-4867-9be3-51f06c9fbd5d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:54.273540 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-14c24ebb-a725-4867-9be3-51f06c9fbd5d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:54.277921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-14c24ebb-a725-4867-9be3-51f06c9fbd5d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:54.279379 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-14c24ebb-a725-4867-9be3-51f06c9fbd5d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:54.347173 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-3e330926-ab2b-4d55-923a-9aad6b8a1982 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:54.356643 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3e330926-ab2b-4d55-923a-9aad6b8a1982 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1370 microversion: 2.1 time: 0.298201 Aug 24 12:34:54.369423 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 143/298] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:54 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1370 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:54.482803 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-14c24ebb-a725-4867-9be3-51f06c9fbd5d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:54.494735 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-14c24ebb-a725-4867-9be3-51f06c9fbd5d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.254666 Aug 24 12:34:54.495648 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 156/299] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:54 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:54.683252 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-520be4e8-46d2-46ae-bbc5-d0a0ce8682ef tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:54.683891 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-520be4e8-46d2-46ae-bbc5-d0a0ce8682ef tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:54.694517 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-520be4e8-46d2-46ae-bbc5-d0a0ce8682ef tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:54.695012 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-520be4e8-46d2-46ae-bbc5-d0a0ce8682ef tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:54.695466 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-520be4e8-46d2-46ae-bbc5-d0a0ce8682ef tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:54.696594 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-520be4e8-46d2-46ae-bbc5-d0a0ce8682ef tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:54.697046 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-520be4e8-46d2-46ae-bbc5-d0a0ce8682ef tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:54.697854 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-520be4e8-46d2-46ae-bbc5-d0a0ce8682ef tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:54.966878 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-520be4e8-46d2-46ae-bbc5-d0a0ce8682ef tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:54.975949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-520be4e8-46d2-46ae-bbc5-d0a0ce8682ef tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:54.976104 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-962725746", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1946886811", "security_groups": [{"name": "tempest-secgroup-smoke-428063021"}], "block_device_mapping_v2": [{"uuid": "1760b78c-0691-4cb4-af07-9eb2f9544641", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "918842e4-eadb-4db7-819f-681445ef12b9"}]}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:54.977459 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-520be4e8-46d2-46ae-bbc5-d0a0ce8682ef tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:54.978624 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-520be4e8-46d2-46ae-bbc5-d0a0ce8682ef tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1740 microversion: 2.20 time: 0.299525 Aug 24 12:34:54.979176 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 144/300] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:54 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1740 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:55.143046 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.network.neutron [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] validate_networks() for [('918842e4-eadb-4db7-819f-681445ef12b9', None, None, None, None, None)] {{(pid=127308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:34:55.217840 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-449d4bf9-500e-4b04-a022-ff24e40fc631 req-4d41bb29-362b-4c01-af8f-dfe540acfc13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09b5ebb-0578-465d-a6ad-03383fdeca05", "name": "network-vif-plugged", "status": "completed", "tag": "170ac04a-b7df-4c9d-939a-edc705e2589c"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:55.240602 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-449d4bf9-500e-4b04-a022-ff24e40fc631 req-4d41bb29-362b-4c01-af8f-dfe540acfc13 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:55.246053 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-449d4bf9-500e-4b04-a022-ff24e40fc631 req-4d41bb29-362b-4c01-af8f-dfe540acfc13 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:55.249405 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-449d4bf9-500e-4b04-a022-ff24e40fc631 req-4d41bb29-362b-4c01-af8f-dfe540acfc13 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:55.280872 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-449d4bf9-500e-4b04-a022-ff24e40fc631 req-4d41bb29-362b-4c01-af8f-dfe540acfc13 service nova] Creating event network-vif-plugged:170ac04a-b7df-4c9d-939a-edc705e2589c for instance e09b5ebb-0578-465d-a6ad-03383fdeca05 on hv-cinder-84890 Aug 24 12:34:55.293353 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-449d4bf9-500e-4b04-a022-ff24e40fc631 req-4d41bb29-362b-4c01-af8f-dfe540acfc13 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080440 Aug 24 12:34:55.296598 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 145/301] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:34:55.311445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c57246ed-ba00-4d8b-9312-78a5d5763c46 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:55.312435 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c57246ed-ba00-4d8b-9312-78a5d5763c46 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:55.330118 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c57246ed-ba00-4d8b-9312-78a5d5763c46 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:55.330937 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c57246ed-ba00-4d8b-9312-78a5d5763c46 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:55.331381 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c57246ed-ba00-4d8b-9312-78a5d5763c46 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:55.332132 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c57246ed-ba00-4d8b-9312-78a5d5763c46 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:55.332803 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c57246ed-ba00-4d8b-9312-78a5d5763c46 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:55.334771 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c57246ed-ba00-4d8b-9312-78a5d5763c46 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:55.797587 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c57246ed-ba00-4d8b-9312-78a5d5763c46 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:55.808830 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c57246ed-ba00-4d8b-9312-78a5d5763c46 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1366 microversion: 2.1 time: 0.510658 Aug 24 12:34:55.816900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 146/302] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:55 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1366 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:55.828227 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8dd71328-3b97-412d-b43f-ec1e104957cb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:55.830130 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8dd71328-3b97-412d-b43f-ec1e104957cb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:55.848769 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Flavor limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:34:55.849385 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Image limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:34:55.850031 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Flavor pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:34:55.850587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Image pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:34:55.851161 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:34:55.858065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8dd71328-3b97-412d-b43f-ec1e104957cb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:55.860668 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8dd71328-3b97-412d-b43f-ec1e104957cb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:55.862077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8dd71328-3b97-412d-b43f-ec1e104957cb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:55.863658 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8dd71328-3b97-412d-b43f-ec1e104957cb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:55.863803 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:55.864174 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:55.864642 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:55.865301 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:55.865417 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8dd71328-3b97-412d-b43f-ec1e104957cb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:55.865769 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:55.866187 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:55.866299 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8dd71328-3b97-412d-b43f-ec1e104957cb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:55.914405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Getting quotas for project aee96e55a6a34dbb81847961d87abad0. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:34:55.920693 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Getting quotas for user 18f8f419b523440f8a4ca06dc83bff40 and project aee96e55a6a34dbb81847961d87abad0. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:34:56.040084 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8dd71328-3b97-412d-b43f-ec1e104957cb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:56.049924 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8dd71328-3b97-412d-b43f-ec1e104957cb tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1370 microversion: 2.1 time: 0.231301 Aug 24 12:34:56.066541 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Going to run 1 instances... {{(pid=127308) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:34:56.068736 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1760b78c-0691-4cb4-af07-9eb2f9544641',volume_size=None,volume_type=None)] {{(pid=127308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:34:56.073584 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 147/303] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:55 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1370 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:56.085192 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-13629683-0f30-440f-b6a6-269a6161bbac tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:56.086329 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-13629683-0f30-440f-b6a6-269a6161bbac tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:56.093117 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-13629683-0f30-440f-b6a6-269a6161bbac tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:56.093618 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-13629683-0f30-440f-b6a6-269a6161bbac tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:56.094056 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-13629683-0f30-440f-b6a6-269a6161bbac tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:56.094768 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-13629683-0f30-440f-b6a6-269a6161bbac tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:56.095228 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-13629683-0f30-440f-b6a6-269a6161bbac tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:56.095687 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-13629683-0f30-440f-b6a6-269a6161bbac tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:56.113327 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=100 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:56.320934 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-13629683-0f30-440f-b6a6-269a6161bbac tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:56.330628 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-13629683-0f30-440f-b6a6-269a6161bbac tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.255891 Aug 24 12:34:56.332520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-ce3d539a-7248-4b8d-ae61-1dbb9ca81384 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.361116 Aug 24 12:34:56.341506 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 157/304] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:34:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:34:56.342060 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 148/305] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:56 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:56.352806 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-575b1d84-2349-41f7-a440-ea1f3af98287 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:56.353098 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-999f2ee6-285d-4dae-aad8-9ba3606dabc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:56.353854 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-575b1d84-2349-41f7-a440-ea1f3af98287 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:56.354454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-999f2ee6-285d-4dae-aad8-9ba3606dabc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:56.368573 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-999f2ee6-285d-4dae-aad8-9ba3606dabc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:56.370359 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-999f2ee6-285d-4dae-aad8-9ba3606dabc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:56.371987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-999f2ee6-285d-4dae-aad8-9ba3606dabc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:56.372919 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-999f2ee6-285d-4dae-aad8-9ba3606dabc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:56.379777 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-999f2ee6-285d-4dae-aad8-9ba3606dabc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:56.380328 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-999f2ee6-285d-4dae-aad8-9ba3606dabc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:56.463604 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-575b1d84-2349-41f7-a440-ea1f3af98287 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:56.477669 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-575b1d84-2349-41f7-a440-ea1f3af98287 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1094 microversion: 2.1 time: 0.129715 Aug 24 12:34:56.478255 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 158/306] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:56 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1094 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:56.637153 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-999f2ee6-285d-4dae-aad8-9ba3606dabc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:56.649551 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-999f2ee6-285d-4dae-aad8-9ba3606dabc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:56.651834 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-999f2ee6-285d-4dae-aad8-9ba3606dabc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:56.653211 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-999f2ee6-285d-4dae-aad8-9ba3606dabc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1740 microversion: 2.20 time: 0.309911 Aug 24 12:34:56.655060 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 149/307] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:56 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1740 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:56.841927 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b49e3208-9a44-4b4d-a6bf-86671d7a8525 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:56.842581 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b49e3208-9a44-4b4d-a6bf-86671d7a8525 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:56.850183 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b49e3208-9a44-4b4d-a6bf-86671d7a8525 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:56.850593 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b49e3208-9a44-4b4d-a6bf-86671d7a8525 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:56.851023 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b49e3208-9a44-4b4d-a6bf-86671d7a8525 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:56.851747 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b49e3208-9a44-4b4d-a6bf-86671d7a8525 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:56.852193 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b49e3208-9a44-4b4d-a6bf-86671d7a8525 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:56.852607 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b49e3208-9a44-4b4d-a6bf-86671d7a8525 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.081327 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-7f5bbed8-996a-40a1-ba3b-d5f61e541ab6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:57.082727 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-7f5bbed8-996a-40a1-ba3b-d5f61e541ab6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:57.089326 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=4 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:57.091935 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f5bbed8-996a-40a1-ba3b-d5f61e541ab6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.092710 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f5bbed8-996a-40a1-ba3b-d5f61e541ab6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.093379 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f5bbed8-996a-40a1-ba3b-d5f61e541ab6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.094518 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f5bbed8-996a-40a1-ba3b-d5f61e541ab6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.095228 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f5bbed8-996a-40a1-ba3b-d5f61e541ab6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.095899 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f5bbed8-996a-40a1-ba3b-d5f61e541ab6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.220408 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=22 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:57.235306 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b49e3208-9a44-4b4d-a6bf-86671d7a8525 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:57.245624 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b49e3208-9a44-4b4d-a6bf-86671d7a8525 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1555 microversion: 2.1 time: 0.419874 Aug 24 12:34:57.257837 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 159/308] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:56 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1555 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:57.280607 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-80dc2cd6-905e-4d4a-a72e-449555f36dd1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:57.281327 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-80dc2cd6-905e-4d4a-a72e-449555f36dd1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:57.302478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-80dc2cd6-905e-4d4a-a72e-449555f36dd1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.302971 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-80dc2cd6-905e-4d4a-a72e-449555f36dd1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.303403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-80dc2cd6-905e-4d4a-a72e-449555f36dd1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.311682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-80dc2cd6-905e-4d4a-a72e-449555f36dd1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.312602 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-80dc2cd6-905e-4d4a-a72e-449555f36dd1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.312841 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-80dc2cd6-905e-4d4a-a72e-449555f36dd1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.414414 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7f5bbed8-996a-40a1-ba3b-d5f61e541ab6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:57.433773 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-7f5bbed8-996a-40a1-ba3b-d5f61e541ab6 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1370 microversion: 2.1 time: 0.364065 Aug 24 12:34:57.434535 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 150/309] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:57 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1370 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:57.442292 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-5a7a58ff-3a20-4b55-9552-b7429827b8f1 req-5bab5850-e972-43d4-b9dc-b055bdcb8f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06fdcfd7-6650-4fe4-8c3a-746ea58f0409", "name": "network-vif-plugged", "status": "completed", "tag": "93921963-7c18-4787-bce0-01c4d4b2201a"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:57.453638 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-5a7a58ff-3a20-4b55-9552-b7429827b8f1 req-5bab5850-e972-43d4-b9dc-b055bdcb8f2e service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.454221 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-5a7a58ff-3a20-4b55-9552-b7429827b8f1 req-5bab5850-e972-43d4-b9dc-b055bdcb8f2e service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.454722 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-5a7a58ff-3a20-4b55-9552-b7429827b8f1 req-5bab5850-e972-43d4-b9dc-b055bdcb8f2e service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.478997 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-80dc2cd6-905e-4d4a-a72e-449555f36dd1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200046 Aug 24 12:34:57.478997 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 160/310] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 12:34:57 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b/os-interface => generated 284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:34:57.495768 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-5a7a58ff-3a20-4b55-9552-b7429827b8f1 req-5bab5850-e972-43d4-b9dc-b055bdcb8f2e service nova] Creating event network-vif-plugged:93921963-7c18-4787-bce0-01c4d4b2201a for instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 on hv-cinder-84890 Aug 24 12:34:57.496784 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f785fdff-18e1-44a1-82b4-ac941af86ee2 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:57.500476 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f785fdff-18e1-44a1-82b4-ac941af86ee2 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:57.507427 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f785fdff-18e1-44a1-82b4-ac941af86ee2 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.508477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f785fdff-18e1-44a1-82b4-ac941af86ee2 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.509074 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-5a7a58ff-3a20-4b55-9552-b7429827b8f1 req-5bab5850-e972-43d4-b9dc-b055bdcb8f2e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068912 Aug 24 12:34:57.509412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f785fdff-18e1-44a1-82b4-ac941af86ee2 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.510543 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f785fdff-18e1-44a1-82b4-ac941af86ee2 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.510769 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 151/311] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:57.515372 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f785fdff-18e1-44a1-82b4-ac941af86ee2 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.516088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f785fdff-18e1-44a1-82b4-ac941af86ee2 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.542209 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a5dc9993-a7ee-419b-b156-d18613dfbcdd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:57.546296 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a5dc9993-a7ee-419b-b156-d18613dfbcdd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:57.563123 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a5dc9993-a7ee-419b-b156-d18613dfbcdd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.567375 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a5dc9993-a7ee-419b-b156-d18613dfbcdd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.568028 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a5dc9993-a7ee-419b-b156-d18613dfbcdd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.569148 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a5dc9993-a7ee-419b-b156-d18613dfbcdd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.569757 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a5dc9993-a7ee-419b-b156-d18613dfbcdd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.571490 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a5dc9993-a7ee-419b-b156-d18613dfbcdd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.687040 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f785fdff-18e1-44a1-82b4-ac941af86ee2 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:57.700138 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f785fdff-18e1-44a1-82b4-ac941af86ee2 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.211074 Aug 24 12:34:57.700961 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 161/312] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:57 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:57.705129 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a5dc9993-a7ee-419b-b156-d18613dfbcdd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:57.723919 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a5dc9993-a7ee-419b-b156-d18613dfbcdd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1192 microversion: 2.1 time: 0.211870 Aug 24 12:34:57.724956 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 152/313] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:57 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1192 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:57.737363 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-cec396e5-4ca8-4418-872e-a8ca10aaf202 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:57.739539 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-cec396e5-4ca8-4418-872e-a8ca10aaf202 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:57.747071 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cec396e5-4ca8-4418-872e-a8ca10aaf202 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.748949 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cec396e5-4ca8-4418-872e-a8ca10aaf202 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.749609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cec396e5-4ca8-4418-872e-a8ca10aaf202 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.750530 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cec396e5-4ca8-4418-872e-a8ca10aaf202 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.751192 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cec396e5-4ca8-4418-872e-a8ca10aaf202 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.751729 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cec396e5-4ca8-4418-872e-a8ca10aaf202 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.958324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cec396e5-4ca8-4418-872e-a8ca10aaf202 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:57.968900 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cec396e5-4ca8-4418-872e-a8ca10aaf202 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:57.970725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cec396e5-4ca8-4418-872e-a8ca10aaf202 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:57.972114 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-cec396e5-4ca8-4418-872e-a8ca10aaf202 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1740 microversion: 2.20 time: 0.247049 Aug 24 12:34:57.972852 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 162/314] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:57 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:58.455466 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e7db77de-2402-4e04-8622-4a4d22d89916 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:58.456116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e7db77de-2402-4e04-8622-4a4d22d89916 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:58.471092 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e7db77de-2402-4e04-8622-4a4d22d89916 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:58.471763 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e7db77de-2402-4e04-8622-4a4d22d89916 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:58.472268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e7db77de-2402-4e04-8622-4a4d22d89916 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:58.473034 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e7db77de-2402-4e04-8622-4a4d22d89916 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:58.473557 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e7db77de-2402-4e04-8622-4a4d22d89916 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:58.474113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e7db77de-2402-4e04-8622-4a4d22d89916 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:58.637875 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e7db77de-2402-4e04-8622-4a4d22d89916 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:58.647512 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e7db77de-2402-4e04-8622-4a4d22d89916 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1370 microversion: 2.1 time: 0.196805 Aug 24 12:34:58.648120 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 153/315] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:58 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:58.726716 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4879c8df-193c-46bd-b6c2-4f03b808ec45 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:58.728699 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4879c8df-193c-46bd-b6c2-4f03b808ec45 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:58.736269 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4879c8df-193c-46bd-b6c2-4f03b808ec45 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:58.736753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4879c8df-193c-46bd-b6c2-4f03b808ec45 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:58.737387 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4879c8df-193c-46bd-b6c2-4f03b808ec45 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:58.738271 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4879c8df-193c-46bd-b6c2-4f03b808ec45 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:58.738715 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4879c8df-193c-46bd-b6c2-4f03b808ec45 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:58.739786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4879c8df-193c-46bd-b6c2-4f03b808ec45 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:58.746674 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ada76122-396f-4503-a9c6-5edef8d9abd0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:58.747998 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ada76122-396f-4503-a9c6-5edef8d9abd0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:58.755661 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ada76122-396f-4503-a9c6-5edef8d9abd0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:58.756163 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ada76122-396f-4503-a9c6-5edef8d9abd0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:58.760333 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ada76122-396f-4503-a9c6-5edef8d9abd0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:58.771745 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ada76122-396f-4503-a9c6-5edef8d9abd0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:58.772326 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ada76122-396f-4503-a9c6-5edef8d9abd0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:58.772773 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ada76122-396f-4503-a9c6-5edef8d9abd0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:58.883937 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ada76122-396f-4503-a9c6-5edef8d9abd0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:58.893529 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ada76122-396f-4503-a9c6-5edef8d9abd0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1210 microversion: 2.1 time: 0.150522 Aug 24 12:34:58.898103 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 154/316] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:58 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1210 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:58.982608 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4879c8df-193c-46bd-b6c2-4f03b808ec45 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:58.987077 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=100 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:58.996045 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-867bb064-e7a5-4d75-a1be-439ef81af393 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:58.996668 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4879c8df-193c-46bd-b6c2-4f03b808ec45 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.273400 Aug 24 12:34:58.997891 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-867bb064-e7a5-4d75-a1be-439ef81af393 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:59.008235 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 163/317] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:58 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:59.015442 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-867bb064-e7a5-4d75-a1be-439ef81af393 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:59.016188 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-867bb064-e7a5-4d75-a1be-439ef81af393 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:59.016817 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-867bb064-e7a5-4d75-a1be-439ef81af393 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:59.017842 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-867bb064-e7a5-4d75-a1be-439ef81af393 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:59.018465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-867bb064-e7a5-4d75-a1be-439ef81af393 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:59.019232 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-867bb064-e7a5-4d75-a1be-439ef81af393 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:59.106316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-8add8677-ffdc-459c-81ff-08eee0e3c426 req-7f8b2d27-d464-4a72-bb3b-91c357748d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a53b53-99f8-423a-b3f2-67416a5a323b", "tag": "cdff0ddd-8433-4eb5-8cd3-028ce16cd9b3"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:59.125714 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-8add8677-ffdc-459c-81ff-08eee0e3c426 req-7f8b2d27-d464-4a72-bb3b-91c357748d45 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:59.126211 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-8add8677-ffdc-459c-81ff-08eee0e3c426 req-7f8b2d27-d464-4a72-bb3b-91c357748d45 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:59.126637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-8add8677-ffdc-459c-81ff-08eee0e3c426 req-7f8b2d27-d464-4a72-bb3b-91c357748d45 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:59.151408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-8add8677-ffdc-459c-81ff-08eee0e3c426 req-7f8b2d27-d464-4a72-bb3b-91c357748d45 service nova] Creating event network-changed:cdff0ddd-8433-4eb5-8cd3-028ce16cd9b3 for instance 32a53b53-99f8-423a-b3f2-67416a5a323b on hv-cinder-84890 Aug 24 12:34:59.157859 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-8add8677-ffdc-459c-81ff-08eee0e3c426 req-7f8b2d27-d464-4a72-bb3b-91c357748d45 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057466 Aug 24 12:34:59.161456 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 164/318] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:59.220993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-867bb064-e7a5-4d75-a1be-439ef81af393 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:59.230534 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-867bb064-e7a5-4d75-a1be-439ef81af393 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:59.232639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-867bb064-e7a5-4d75-a1be-439ef81af393 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:59.234528 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-867bb064-e7a5-4d75-a1be-439ef81af393 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1740 microversion: 2.20 time: 0.242337 Aug 24 12:34:59.235708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 155/319] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:58 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:59.670847 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4e89db25-4180-4cf9-bfde-92a6d30fbd23 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:59.671934 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4e89db25-4180-4cf9-bfde-92a6d30fbd23 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:59.682340 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e89db25-4180-4cf9-bfde-92a6d30fbd23 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:59.685502 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e89db25-4180-4cf9-bfde-92a6d30fbd23 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:59.686124 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e89db25-4180-4cf9-bfde-92a6d30fbd23 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:59.686954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e89db25-4180-4cf9-bfde-92a6d30fbd23 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:59.687520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e89db25-4180-4cf9-bfde-92a6d30fbd23 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:59.690637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e89db25-4180-4cf9-bfde-92a6d30fbd23 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:59.854014 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4e89db25-4180-4cf9-bfde-92a6d30fbd23 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:59.861921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4e89db25-4180-4cf9-bfde-92a6d30fbd23 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1370 microversion: 2.1 time: 0.195253 Aug 24 12:34:59.863616 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 165/320] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:59 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:59.919159 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f74619ee-bcca-4bc0-8024-1c6691fb47a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:59.920586 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f74619ee-bcca-4bc0-8024-1c6691fb47a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:59.929970 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f74619ee-bcca-4bc0-8024-1c6691fb47a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:59.940320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f74619ee-bcca-4bc0-8024-1c6691fb47a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:59.940892 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f74619ee-bcca-4bc0-8024-1c6691fb47a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:59.941833 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f74619ee-bcca-4bc0-8024-1c6691fb47a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:59.942463 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f74619ee-bcca-4bc0-8024-1c6691fb47a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:59.942902 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f74619ee-bcca-4bc0-8024-1c6691fb47a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:00.019390 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-cd68c6fe-007c-4f9f-af86-7140f3c9f74e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:00.020037 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-cd68c6fe-007c-4f9f-af86-7140f3c9f74e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:00.028934 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cd68c6fe-007c-4f9f-af86-7140f3c9f74e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:00.030985 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cd68c6fe-007c-4f9f-af86-7140f3c9f74e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:00.033879 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cd68c6fe-007c-4f9f-af86-7140f3c9f74e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:00.035192 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cd68c6fe-007c-4f9f-af86-7140f3c9f74e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:00.035836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cd68c6fe-007c-4f9f-af86-7140f3c9f74e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:00.045854 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cd68c6fe-007c-4f9f-af86-7140f3c9f74e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:00.047561 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f74619ee-bcca-4bc0-8024-1c6691fb47a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:00.057249 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f74619ee-bcca-4bc0-8024-1c6691fb47a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1210 microversion: 2.1 time: 0.142368 Aug 24 12:35:00.058812 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 156/321] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:59 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1210 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:00.228642 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cd68c6fe-007c-4f9f-af86-7140f3c9f74e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:00.238467 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-cd68c6fe-007c-4f9f-af86-7140f3c9f74e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.222651 Aug 24 12:35:00.239045 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 166/322] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:00 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:00.263007 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8ffbb8e9-96f4-4351-b0af-58e8943eb95a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:00.264832 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8ffbb8e9-96f4-4351-b0af-58e8943eb95a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:00.272288 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8ffbb8e9-96f4-4351-b0af-58e8943eb95a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:00.273184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8ffbb8e9-96f4-4351-b0af-58e8943eb95a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:00.273699 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8ffbb8e9-96f4-4351-b0af-58e8943eb95a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:00.275595 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8ffbb8e9-96f4-4351-b0af-58e8943eb95a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:00.276156 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8ffbb8e9-96f4-4351-b0af-58e8943eb95a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:00.276747 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8ffbb8e9-96f4-4351-b0af-58e8943eb95a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:00.488646 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8ffbb8e9-96f4-4351-b0af-58e8943eb95a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:00.500945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8ffbb8e9-96f4-4351-b0af-58e8943eb95a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:00.503222 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8ffbb8e9-96f4-4351-b0af-58e8943eb95a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:00.504725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8ffbb8e9-96f4-4351-b0af-58e8943eb95a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1740 microversion: 2.20 time: 0.247073 Aug 24 12:35:00.525890 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 157/323] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:00 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:00.882556 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-cad647b6-9201-44a9-8cf5-f2991f16b37f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:00.883217 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-cad647b6-9201-44a9-8cf5-f2991f16b37f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:00.885959 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:00.894976 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cad647b6-9201-44a9-8cf5-f2991f16b37f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:00.895830 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cad647b6-9201-44a9-8cf5-f2991f16b37f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:00.896595 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cad647b6-9201-44a9-8cf5-f2991f16b37f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:00.897494 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cad647b6-9201-44a9-8cf5-f2991f16b37f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:00.897957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cad647b6-9201-44a9-8cf5-f2991f16b37f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:00.898382 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cad647b6-9201-44a9-8cf5-f2991f16b37f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:01.058005 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cad647b6-9201-44a9-8cf5-f2991f16b37f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:01.070087 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-cad647b6-9201-44a9-8cf5-f2991f16b37f tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1370 microversion: 2.1 time: 0.191298 Aug 24 12:35:01.071448 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 167/324] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:00 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:01.080612 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-aa2a5e9a-0f58-42b2-8b66-fc71f01dacf3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:01.081799 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-aa2a5e9a-0f58-42b2-8b66-fc71f01dacf3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:01.089862 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-aa2a5e9a-0f58-42b2-8b66-fc71f01dacf3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:01.090574 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-aa2a5e9a-0f58-42b2-8b66-fc71f01dacf3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:01.092613 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-aa2a5e9a-0f58-42b2-8b66-fc71f01dacf3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:01.093868 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-aa2a5e9a-0f58-42b2-8b66-fc71f01dacf3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:01.094773 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-aa2a5e9a-0f58-42b2-8b66-fc71f01dacf3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:01.096058 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-aa2a5e9a-0f58-42b2-8b66-fc71f01dacf3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:01.261497 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-aa2a5e9a-0f58-42b2-8b66-fc71f01dacf3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:01.264109 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ac1d6fab-ecc4-4312-99fb-5eb69ca85a6e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:01.264701 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-ac1d6fab-ecc4-4312-99fb-5eb69ca85a6e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:01.273495 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-aa2a5e9a-0f58-42b2-8b66-fc71f01dacf3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1277 microversion: 2.1 time: 0.197067 Aug 24 12:35:01.274501 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 158/325] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:01 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:01.274856 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ac1d6fab-ecc4-4312-99fb-5eb69ca85a6e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:01.275348 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ac1d6fab-ecc4-4312-99fb-5eb69ca85a6e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:01.280359 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ac1d6fab-ecc4-4312-99fb-5eb69ca85a6e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:01.283957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ac1d6fab-ecc4-4312-99fb-5eb69ca85a6e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:01.285068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ac1d6fab-ecc4-4312-99fb-5eb69ca85a6e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:01.285744 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ac1d6fab-ecc4-4312-99fb-5eb69ca85a6e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:01.453058 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ac1d6fab-ecc4-4312-99fb-5eb69ca85a6e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:01.461857 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-ac1d6fab-ecc4-4312-99fb-5eb69ca85a6e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.203429 Aug 24 12:35:01.462451 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 168/326] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:01 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:01.539774 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b78faaec-7629-49a7-b0e8-e7b072f6769a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:01.540608 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-b78faaec-7629-49a7-b0e8-e7b072f6769a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:01.553230 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b78faaec-7629-49a7-b0e8-e7b072f6769a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:01.558057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b78faaec-7629-49a7-b0e8-e7b072f6769a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:01.558616 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b78faaec-7629-49a7-b0e8-e7b072f6769a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:01.559379 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b78faaec-7629-49a7-b0e8-e7b072f6769a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:01.560402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b78faaec-7629-49a7-b0e8-e7b072f6769a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:01.560831 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b78faaec-7629-49a7-b0e8-e7b072f6769a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:01.740730 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b78faaec-7629-49a7-b0e8-e7b072f6769a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:01.755893 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b78faaec-7629-49a7-b0e8-e7b072f6769a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:01.760483 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b78faaec-7629-49a7-b0e8-e7b072f6769a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:01.765492 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b78faaec-7629-49a7-b0e8-e7b072f6769a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1740 microversion: 2.20 time: 0.236021 Aug 24 12:35:01.769025 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 159/327] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:01 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:02.092989 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-3b8e05a8-51de-4dcc-83d5-8b5d915336c9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:02.093625 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-3b8e05a8-51de-4dcc-83d5-8b5d915336c9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:02.111782 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3b8e05a8-51de-4dcc-83d5-8b5d915336c9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.112752 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3b8e05a8-51de-4dcc-83d5-8b5d915336c9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.113379 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3b8e05a8-51de-4dcc-83d5-8b5d915336c9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.114295 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3b8e05a8-51de-4dcc-83d5-8b5d915336c9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.114937 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3b8e05a8-51de-4dcc-83d5-8b5d915336c9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.115539 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3b8e05a8-51de-4dcc-83d5-8b5d915336c9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.295061 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b282a979-6b4e-4e7e-ae17-de73a935d0e0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:02.296624 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-b282a979-6b4e-4e7e-ae17-de73a935d0e0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:02.304496 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b282a979-6b4e-4e7e-ae17-de73a935d0e0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.305462 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b282a979-6b4e-4e7e-ae17-de73a935d0e0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.306233 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b282a979-6b4e-4e7e-ae17-de73a935d0e0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.307109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b282a979-6b4e-4e7e-ae17-de73a935d0e0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.307882 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b282a979-6b4e-4e7e-ae17-de73a935d0e0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.308496 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b282a979-6b4e-4e7e-ae17-de73a935d0e0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.344595 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-3b8e05a8-51de-4dcc-83d5-8b5d915336c9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:02.362570 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-3b8e05a8-51de-4dcc-83d5-8b5d915336c9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1370 microversion: 2.1 time: 0.272594 Aug 24 12:35:02.386454 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 169/328] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:02 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1370 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:02.482806 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2d0cca41-53ab-4ad5-b1db-b2614dcc8872 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:02.483530 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2d0cca41-53ab-4ad5-b1db-b2614dcc8872 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:02.490602 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2d0cca41-53ab-4ad5-b1db-b2614dcc8872 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.491096 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2d0cca41-53ab-4ad5-b1db-b2614dcc8872 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.491528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2d0cca41-53ab-4ad5-b1db-b2614dcc8872 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.492268 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2d0cca41-53ab-4ad5-b1db-b2614dcc8872 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.492718 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2d0cca41-53ab-4ad5-b1db-b2614dcc8872 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.493133 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2d0cca41-53ab-4ad5-b1db-b2614dcc8872 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.519585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b282a979-6b4e-4e7e-ae17-de73a935d0e0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:02.529902 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b282a979-6b4e-4e7e-ae17-de73a935d0e0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.239077 Aug 24 12:35:02.531220 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 160/329] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:02 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:02.567825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-e4dbb41a-5b93-4c9d-bf3f-fe5dee5b1adb req-0d2067e1-ccc6-43de-b077-4a9980429c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab4d787-eab3-4654-8d9c-b7a7f10972ca", "tag": "0d661b8c-9ce8-4cb3-aeff-26f9ef9ed93e"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:02.583833 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-e4dbb41a-5b93-4c9d-bf3f-fe5dee5b1adb req-0d2067e1-ccc6-43de-b077-4a9980429c67 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.584801 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-e4dbb41a-5b93-4c9d-bf3f-fe5dee5b1adb req-0d2067e1-ccc6-43de-b077-4a9980429c67 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.586791 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-e4dbb41a-5b93-4c9d-bf3f-fe5dee5b1adb req-0d2067e1-ccc6-43de-b077-4a9980429c67 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.604425 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-e4dbb41a-5b93-4c9d-bf3f-fe5dee5b1adb req-0d2067e1-ccc6-43de-b077-4a9980429c67 service nova] Creating event network-changed:0d661b8c-9ce8-4cb3-aeff-26f9ef9ed93e for instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca on hv-cinder-84890 Aug 24 12:35:02.612329 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-e4dbb41a-5b93-4c9d-bf3f-fe5dee5b1adb req-0d2067e1-ccc6-43de-b077-4a9980429c67 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047795 Aug 24 12:35:02.614019 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 161/330] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:35:02.729834 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2d0cca41-53ab-4ad5-b1db-b2614dcc8872 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:02.739869 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2d0cca41-53ab-4ad5-b1db-b2614dcc8872 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.261301 Aug 24 12:35:02.754697 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 170/331] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:02 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:02.792475 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-cd08d529-3180-47f8-a8dc-e314f6c71450 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:02.793270 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-cd08d529-3180-47f8-a8dc-e314f6c71450 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:02.815257 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cd08d529-3180-47f8-a8dc-e314f6c71450 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.815704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cd08d529-3180-47f8-a8dc-e314f6c71450 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.816153 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cd08d529-3180-47f8-a8dc-e314f6c71450 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.816874 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cd08d529-3180-47f8-a8dc-e314f6c71450 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.817331 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cd08d529-3180-47f8-a8dc-e314f6c71450 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.817763 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cd08d529-3180-47f8-a8dc-e314f6c71450 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.985050 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-cd08d529-3180-47f8-a8dc-e314f6c71450 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:02.993990 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-cd08d529-3180-47f8-a8dc-e314f6c71450 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:02.995846 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-cd08d529-3180-47f8-a8dc-e314f6c71450 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:02.997086 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-cd08d529-3180-47f8-a8dc-e314f6c71450 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1740 microversion: 2.20 time: 0.208893 Aug 24 12:35:02.997820 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 162/332] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:02 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:03.394246 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e328f445-4d39-42ea-bc4a-6c42fe254a8a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:03.394623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e328f445-4d39-42ea-bc4a-6c42fe254a8a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:03.403667 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e328f445-4d39-42ea-bc4a-6c42fe254a8a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.409035 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e328f445-4d39-42ea-bc4a-6c42fe254a8a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.409821 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e328f445-4d39-42ea-bc4a-6c42fe254a8a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.411052 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e328f445-4d39-42ea-bc4a-6c42fe254a8a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.411971 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e328f445-4d39-42ea-bc4a-6c42fe254a8a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.412618 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e328f445-4d39-42ea-bc4a-6c42fe254a8a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.552733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2bf7f71a-528c-44a9-93c6-a3e6c790d8ee tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:03.554078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2bf7f71a-528c-44a9-93c6-a3e6c790d8ee tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:03.562618 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2bf7f71a-528c-44a9-93c6-a3e6c790d8ee tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.563468 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2bf7f71a-528c-44a9-93c6-a3e6c790d8ee tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.564164 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2bf7f71a-528c-44a9-93c6-a3e6c790d8ee tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.568141 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e328f445-4d39-42ea-bc4a-6c42fe254a8a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:03.572376 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2bf7f71a-528c-44a9-93c6-a3e6c790d8ee tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.577335 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e328f445-4d39-42ea-bc4a-6c42fe254a8a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1564 microversion: 2.1 time: 0.187260 Aug 24 12:35:03.578120 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2bf7f71a-528c-44a9-93c6-a3e6c790d8ee tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.578811 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2bf7f71a-528c-44a9-93c6-a3e6c790d8ee tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.581352 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 171/333] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:03 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1564 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:03.603830 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-53234bb0-0ebc-4099-8c8f-13afed9fb53c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:03.604715 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-53234bb0-0ebc-4099-8c8f-13afed9fb53c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:03.613082 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53234bb0-0ebc-4099-8c8f-13afed9fb53c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.613836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53234bb0-0ebc-4099-8c8f-13afed9fb53c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.614265 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53234bb0-0ebc-4099-8c8f-13afed9fb53c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.615182 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53234bb0-0ebc-4099-8c8f-13afed9fb53c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.615669 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53234bb0-0ebc-4099-8c8f-13afed9fb53c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.616101 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53234bb0-0ebc-4099-8c8f-13afed9fb53c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.735893 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-53234bb0-0ebc-4099-8c8f-13afed9fb53c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136322 Aug 24 12:35:03.750992 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 172/334] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 12:35:03 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:03.762467 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-59aad603-f487-4873-b425-1ad2126dfed4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:03.763416 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-59aad603-f487-4873-b425-1ad2126dfed4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:03.779743 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59aad603-f487-4873-b425-1ad2126dfed4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.780490 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59aad603-f487-4873-b425-1ad2126dfed4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.780920 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59aad603-f487-4873-b425-1ad2126dfed4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.781626 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59aad603-f487-4873-b425-1ad2126dfed4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.782074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59aad603-f487-4873-b425-1ad2126dfed4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.782490 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59aad603-f487-4873-b425-1ad2126dfed4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.795097 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2bf7f71a-528c-44a9-93c6-a3e6c790d8ee tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:03.804017 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2bf7f71a-528c-44a9-93c6-a3e6c790d8ee tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.256112 Aug 24 12:35:03.805193 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 163/335] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:03 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:04.012380 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-59aad603-f487-4873-b425-1ad2126dfed4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:04.019966 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-30bdc378-81a1-4e4b-97d3-279f14a7fab7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:04.021319 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-30bdc378-81a1-4e4b-97d3-279f14a7fab7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:04.032038 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-30bdc378-81a1-4e4b-97d3-279f14a7fab7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:04.036730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-59aad603-f487-4873-b425-1ad2126dfed4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.278210 Aug 24 12:35:04.037572 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-30bdc378-81a1-4e4b-97d3-279f14a7fab7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:04.038256 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-30bdc378-81a1-4e4b-97d3-279f14a7fab7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:04.038885 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 173/336] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:03 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:04.039854 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-30bdc378-81a1-4e4b-97d3-279f14a7fab7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:04.040398 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-30bdc378-81a1-4e4b-97d3-279f14a7fab7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:04.040907 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-30bdc378-81a1-4e4b-97d3-279f14a7fab7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:04.214111 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-30bdc378-81a1-4e4b-97d3-279f14a7fab7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:04.229980 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-30bdc378-81a1-4e4b-97d3-279f14a7fab7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:04.232089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-30bdc378-81a1-4e4b-97d3-279f14a7fab7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:04.233500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-30bdc378-81a1-4e4b-97d3-279f14a7fab7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1740 microversion: 2.20 time: 0.217329 Aug 24 12:35:04.234282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 164/337] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:04 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:04.827920 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-0c86209e-7465-4f8c-aef4-d812a9251cfc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:04.829324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-0c86209e-7465-4f8c-aef4-d812a9251cfc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:04.835975 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0c86209e-7465-4f8c-aef4-d812a9251cfc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:04.836460 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0c86209e-7465-4f8c-aef4-d812a9251cfc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:04.836893 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0c86209e-7465-4f8c-aef4-d812a9251cfc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:04.837587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0c86209e-7465-4f8c-aef4-d812a9251cfc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:04.838060 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0c86209e-7465-4f8c-aef4-d812a9251cfc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:04.838668 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0c86209e-7465-4f8c-aef4-d812a9251cfc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:04.901323 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-cf10ef57-0dd4-48b7-8624-30736da2630f req-6d589fac-2d4a-4341-833b-11b429d379b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fdcfd7-6650-4fe4-8c3a-746ea58f0409", "tag": "93921963-7c18-4787-bce0-01c4d4b2201a"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:04.928105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-cf10ef57-0dd4-48b7-8624-30736da2630f req-6d589fac-2d4a-4341-833b-11b429d379b1 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:04.928592 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-cf10ef57-0dd4-48b7-8624-30736da2630f req-6d589fac-2d4a-4341-833b-11b429d379b1 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:04.929029 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-cf10ef57-0dd4-48b7-8624-30736da2630f req-6d589fac-2d4a-4341-833b-11b429d379b1 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:04.947717 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-cf10ef57-0dd4-48b7-8624-30736da2630f req-6d589fac-2d4a-4341-833b-11b429d379b1 service nova] Creating event network-changed:93921963-7c18-4787-bce0-01c4d4b2201a for instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 on hv-cinder-84890 Aug 24 12:35:04.953966 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-cf10ef57-0dd4-48b7-8624-30736da2630f req-6d589fac-2d4a-4341-833b-11b429d379b1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056257 Aug 24 12:35:04.957630 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 165/338] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:05.041943 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-0c86209e-7465-4f8c-aef4-d812a9251cfc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:05.051377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-0c86209e-7465-4f8c-aef4-d812a9251cfc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.227917 Aug 24 12:35:05.052691 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 174/339] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:04 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:05.063153 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c4d06be6-b16f-4d9a-b409-fff33b418757 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:05.063889 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c4d06be6-b16f-4d9a-b409-fff33b418757 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:05.071103 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c4d06be6-b16f-4d9a-b409-fff33b418757 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:05.071768 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c4d06be6-b16f-4d9a-b409-fff33b418757 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:05.072451 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c4d06be6-b16f-4d9a-b409-fff33b418757 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:05.074167 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c4d06be6-b16f-4d9a-b409-fff33b418757 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:05.074897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c4d06be6-b16f-4d9a-b409-fff33b418757 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:05.075584 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c4d06be6-b16f-4d9a-b409-fff33b418757 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:05.247407 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c4d06be6-b16f-4d9a-b409-fff33b418757 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:05.258394 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-cbb6241f-02bf-402e-a802-994adc0f4375 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:05.259819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-cbb6241f-02bf-402e-a802-994adc0f4375 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:05.262850 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c4d06be6-b16f-4d9a-b409-fff33b418757 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.204484 Aug 24 12:35:05.264635 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 166/340] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:05 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:05.280888 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cbb6241f-02bf-402e-a802-994adc0f4375 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:05.281756 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cbb6241f-02bf-402e-a802-994adc0f4375 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:05.282433 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cbb6241f-02bf-402e-a802-994adc0f4375 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:05.283378 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cbb6241f-02bf-402e-a802-994adc0f4375 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:05.284066 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cbb6241f-02bf-402e-a802-994adc0f4375 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:05.284696 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cbb6241f-02bf-402e-a802-994adc0f4375 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:05.436783 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cbb6241f-02bf-402e-a802-994adc0f4375 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:05.446904 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cbb6241f-02bf-402e-a802-994adc0f4375 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:05.448756 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cbb6241f-02bf-402e-a802-994adc0f4375 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:05.450841 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-cbb6241f-02bf-402e-a802-994adc0f4375 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1740 microversion: 2.20 time: 0.196235 Aug 24 12:35:05.463649 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 175/341] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:05 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:06.074526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d4df6041-d645-442d-acbb-4ab0a487be1e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:06.075422 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d4df6041-d645-442d-acbb-4ab0a487be1e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:06.085032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4df6041-d645-442d-acbb-4ab0a487be1e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.088015 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4df6041-d645-442d-acbb-4ab0a487be1e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.088876 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4df6041-d645-442d-acbb-4ab0a487be1e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.089848 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4df6041-d645-442d-acbb-4ab0a487be1e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.090520 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4df6041-d645-442d-acbb-4ab0a487be1e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.092296 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4df6041-d645-442d-acbb-4ab0a487be1e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.099399 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=100 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:06.285364 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-31b4a126-1a27-4cc5-a85b-ce2ac74a0b0f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:06.285975 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-31b4a126-1a27-4cc5-a85b-ce2ac74a0b0f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:06.288716 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:06.294583 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-31b4a126-1a27-4cc5-a85b-ce2ac74a0b0f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.295093 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-31b4a126-1a27-4cc5-a85b-ce2ac74a0b0f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.295512 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-31b4a126-1a27-4cc5-a85b-ce2ac74a0b0f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.296472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-31b4a126-1a27-4cc5-a85b-ce2ac74a0b0f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.296927 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-31b4a126-1a27-4cc5-a85b-ce2ac74a0b0f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.297511 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-31b4a126-1a27-4cc5-a85b-ce2ac74a0b0f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.377853 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-d4df6041-d645-442d-acbb-4ab0a487be1e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:06.386758 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d4df6041-d645-442d-acbb-4ab0a487be1e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.317598 Aug 24 12:35:06.396038 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 167/342] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:06 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:06.468277 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=8 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:06.475108 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c3755df3-e290-4949-9a21-eed59705d26b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:06.475776 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c3755df3-e290-4949-9a21-eed59705d26b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:06.481741 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c3755df3-e290-4949-9a21-eed59705d26b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.482234 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c3755df3-e290-4949-9a21-eed59705d26b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.482665 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c3755df3-e290-4949-9a21-eed59705d26b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.483365 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c3755df3-e290-4949-9a21-eed59705d26b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.483855 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c3755df3-e290-4949-9a21-eed59705d26b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.484287 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c3755df3-e290-4949-9a21-eed59705d26b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.496719 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-31b4a126-1a27-4cc5-a85b-ce2ac74a0b0f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:06.505169 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-31b4a126-1a27-4cc5-a85b-ce2ac74a0b0f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.223665 Aug 24 12:35:06.505736 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 176/343] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:06 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:06.665627 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c3755df3-e290-4949-9a21-eed59705d26b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:06.673606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c3755df3-e290-4949-9a21-eed59705d26b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:06.675111 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c3755df3-e290-4949-9a21-eed59705d26b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:06.676289 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c3755df3-e290-4949-9a21-eed59705d26b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1740 microversion: 2.20 time: 0.205074 Aug 24 12:35:06.676846 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 168/344] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:06 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:07.415892 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4018f189-b4ce-4951-b1a7-9f1a641321fc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:07.416612 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4018f189-b4ce-4951-b1a7-9f1a641321fc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:07.423704 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4018f189-b4ce-4951-b1a7-9f1a641321fc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.424183 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4018f189-b4ce-4951-b1a7-9f1a641321fc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.424608 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4018f189-b4ce-4951-b1a7-9f1a641321fc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.425294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4018f189-b4ce-4951-b1a7-9f1a641321fc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.425742 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4018f189-b4ce-4951-b1a7-9f1a641321fc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.426162 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4018f189-b4ce-4951-b1a7-9f1a641321fc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.526312 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ef706bdc-f7eb-4bd3-bbfa-3341e8da6ae9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:07.526928 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ef706bdc-f7eb-4bd3-bbfa-3341e8da6ae9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:07.534242 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ef706bdc-f7eb-4bd3-bbfa-3341e8da6ae9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.534731 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ef706bdc-f7eb-4bd3-bbfa-3341e8da6ae9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.535171 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ef706bdc-f7eb-4bd3-bbfa-3341e8da6ae9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.535896 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ef706bdc-f7eb-4bd3-bbfa-3341e8da6ae9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.536356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ef706bdc-f7eb-4bd3-bbfa-3341e8da6ae9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.536781 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ef706bdc-f7eb-4bd3-bbfa-3341e8da6ae9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.555199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4018f189-b4ce-4951-b1a7-9f1a641321fc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:07.563304 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4018f189-b4ce-4951-b1a7-9f1a641321fc tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.151370 Aug 24 12:35:07.563904 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 177/345] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:07 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:07.665951 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ef706bdc-f7eb-4bd3-bbfa-3341e8da6ae9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:07.674772 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ef706bdc-f7eb-4bd3-bbfa-3341e8da6ae9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.152327 Aug 24 12:35:07.675336 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 169/346] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:07 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:07.701389 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9c6de42f-1ad2-407b-b9f8-edfbae355203 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:07.702322 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9c6de42f-1ad2-407b-b9f8-edfbae355203 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:07.708238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9c6de42f-1ad2-407b-b9f8-edfbae355203 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.708714 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9c6de42f-1ad2-407b-b9f8-edfbae355203 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.709145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9c6de42f-1ad2-407b-b9f8-edfbae355203 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.709827 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9c6de42f-1ad2-407b-b9f8-edfbae355203 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.710278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9c6de42f-1ad2-407b-b9f8-edfbae355203 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.710699 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9c6de42f-1ad2-407b-b9f8-edfbae355203 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.841651 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9c6de42f-1ad2-407b-b9f8-edfbae355203 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:07.849767 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9c6de42f-1ad2-407b-b9f8-edfbae355203 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:07.851263 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9c6de42f-1ad2-407b-b9f8-edfbae355203 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:07.852444 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9c6de42f-1ad2-407b-b9f8-edfbae355203 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1722 microversion: 2.20 time: 0.155636 Aug 24 12:35:07.853007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 178/347] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:07 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:08.584031 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2ce63a4e-66fb-497e-b32f-1590512fccfd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:08.584674 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2ce63a4e-66fb-497e-b32f-1590512fccfd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:08.591048 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2ce63a4e-66fb-497e-b32f-1590512fccfd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.591600 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2ce63a4e-66fb-497e-b32f-1590512fccfd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.592072 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2ce63a4e-66fb-497e-b32f-1590512fccfd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:08.592749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2ce63a4e-66fb-497e-b32f-1590512fccfd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.593197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2ce63a4e-66fb-497e-b32f-1590512fccfd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.593617 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2ce63a4e-66fb-497e-b32f-1590512fccfd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:08.695797 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-20fe39f0-05dd-460c-915a-fa001182846e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:08.696411 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-20fe39f0-05dd-460c-915a-fa001182846e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:08.703413 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-20fe39f0-05dd-460c-915a-fa001182846e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.703924 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-20fe39f0-05dd-460c-915a-fa001182846e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.704390 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-20fe39f0-05dd-460c-915a-fa001182846e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:08.705084 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-20fe39f0-05dd-460c-915a-fa001182846e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.705568 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-20fe39f0-05dd-460c-915a-fa001182846e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.705989 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-20fe39f0-05dd-460c-915a-fa001182846e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:08.721955 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2ce63a4e-66fb-497e-b32f-1590512fccfd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:08.729612 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2ce63a4e-66fb-497e-b32f-1590512fccfd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.149382 Aug 24 12:35:08.730184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 170/348] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:08 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:08.838954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-20fe39f0-05dd-460c-915a-fa001182846e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:08.847680 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-20fe39f0-05dd-460c-915a-fa001182846e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.155685 Aug 24 12:35:08.848241 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 179/349] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:08 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:08.875925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5553a330-6d85-48dc-8730-caa8372324b6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:08.876567 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5553a330-6d85-48dc-8730-caa8372324b6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:08.882672 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5553a330-6d85-48dc-8730-caa8372324b6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.883170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5553a330-6d85-48dc-8730-caa8372324b6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.883612 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5553a330-6d85-48dc-8730-caa8372324b6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:08.884340 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5553a330-6d85-48dc-8730-caa8372324b6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.884796 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5553a330-6d85-48dc-8730-caa8372324b6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.885229 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5553a330-6d85-48dc-8730-caa8372324b6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:09.013208 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5553a330-6d85-48dc-8730-caa8372324b6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:09.021393 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5553a330-6d85-48dc-8730-caa8372324b6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:09.022921 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5553a330-6d85-48dc-8730-caa8372324b6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:09.024101 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5553a330-6d85-48dc-8730-caa8372324b6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1722 microversion: 2.20 time: 0.152221 Aug 24 12:35:09.024652 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 171/350] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:08 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:09.750453 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-0d5df65f-d1ac-4ec9-a03f-163a96e5b2ba tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:09.751061 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-0d5df65f-d1ac-4ec9-a03f-163a96e5b2ba tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:09.757565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0d5df65f-d1ac-4ec9-a03f-163a96e5b2ba tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:09.758042 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0d5df65f-d1ac-4ec9-a03f-163a96e5b2ba tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:09.758471 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0d5df65f-d1ac-4ec9-a03f-163a96e5b2ba tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:09.759151 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0d5df65f-d1ac-4ec9-a03f-163a96e5b2ba tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:09.759640 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0d5df65f-d1ac-4ec9-a03f-163a96e5b2ba tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:09.760070 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0d5df65f-d1ac-4ec9-a03f-163a96e5b2ba tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:09.869455 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a243db53-18d5-4982-a341-ad316aad2d61 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:09.870084 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a243db53-18d5-4982-a341-ad316aad2d61 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:09.877558 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a243db53-18d5-4982-a341-ad316aad2d61 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:09.878048 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a243db53-18d5-4982-a341-ad316aad2d61 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:09.878482 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a243db53-18d5-4982-a341-ad316aad2d61 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:09.879183 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a243db53-18d5-4982-a341-ad316aad2d61 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:09.879679 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a243db53-18d5-4982-a341-ad316aad2d61 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:09.880100 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a243db53-18d5-4982-a341-ad316aad2d61 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:09.896129 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-0d5df65f-d1ac-4ec9-a03f-163a96e5b2ba tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:09.904414 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-0d5df65f-d1ac-4ec9-a03f-163a96e5b2ba tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.157903 Aug 24 12:35:09.904981 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 180/351] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:09 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:10.013641 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a243db53-18d5-4982-a341-ad316aad2d61 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:10.021788 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a243db53-18d5-4982-a341-ad316aad2d61 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.156164 Aug 24 12:35:10.022349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 172/352] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:09 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:10.047802 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1107bf2d-a5ba-4369-a484-dfc088723bff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:10.048425 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1107bf2d-a5ba-4369-a484-dfc088723bff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:10.054250 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1107bf2d-a5ba-4369-a484-dfc088723bff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.054729 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1107bf2d-a5ba-4369-a484-dfc088723bff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.055149 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1107bf2d-a5ba-4369-a484-dfc088723bff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.055849 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1107bf2d-a5ba-4369-a484-dfc088723bff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.056295 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1107bf2d-a5ba-4369-a484-dfc088723bff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.056705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1107bf2d-a5ba-4369-a484-dfc088723bff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.074507 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=100 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:10.186203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1107bf2d-a5ba-4369-a484-dfc088723bff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:10.194388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1107bf2d-a5ba-4369-a484-dfc088723bff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:10.195899 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1107bf2d-a5ba-4369-a484-dfc088723bff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:10.197026 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1107bf2d-a5ba-4369-a484-dfc088723bff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1722 microversion: 2.20 time: 0.153116 Aug 24 12:35:10.197578 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 181/353] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:10 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:10.378277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-c9532ead-836e-4f30-8773-09a0f31b857c req-aa19fe21-9390-43f2-9f5a-039b894aa32c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09b5ebb-0578-465d-a6ad-03383fdeca05", "name": "network-vif-unplugged", "status": "completed", "tag": "170ac04a-b7df-4c9d-939a-edc705e2589c"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:10.388220 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-c9532ead-836e-4f30-8773-09a0f31b857c req-aa19fe21-9390-43f2-9f5a-039b894aa32c service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.388726 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-c9532ead-836e-4f30-8773-09a0f31b857c req-aa19fe21-9390-43f2-9f5a-039b894aa32c service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.389154 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-c9532ead-836e-4f30-8773-09a0f31b857c req-aa19fe21-9390-43f2-9f5a-039b894aa32c service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.400209 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-c9532ead-836e-4f30-8773-09a0f31b857c req-aa19fe21-9390-43f2-9f5a-039b894aa32c service nova] Creating event network-vif-unplugged:170ac04a-b7df-4c9d-939a-edc705e2589c for instance e09b5ebb-0578-465d-a6ad-03383fdeca05 on hv-cinder-84890 Aug 24 12:35:10.404890 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-c9532ead-836e-4f30-8773-09a0f31b857c req-aa19fe21-9390-43f2-9f5a-039b894aa32c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030317 Aug 24 12:35:10.405627 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 173/354] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:35:10.924984 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-83b24ad5-0c02-4fad-b744-412494c3fc19 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:10.925606 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-83b24ad5-0c02-4fad-b744-412494c3fc19 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:10.931971 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-83b24ad5-0c02-4fad-b744-412494c3fc19 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.932447 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-83b24ad5-0c02-4fad-b744-412494c3fc19 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.932878 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-83b24ad5-0c02-4fad-b744-412494c3fc19 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.933554 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-83b24ad5-0c02-4fad-b744-412494c3fc19 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.934007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-83b24ad5-0c02-4fad-b744-412494c3fc19 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.935018 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-83b24ad5-0c02-4fad-b744-412494c3fc19 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.044668 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5af851b6-8d31-4aeb-b672-c2171674c104 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:11.045403 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5af851b6-8d31-4aeb-b672-c2171674c104 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:11.051507 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5af851b6-8d31-4aeb-b672-c2171674c104 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.052027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5af851b6-8d31-4aeb-b672-c2171674c104 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.052467 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5af851b6-8d31-4aeb-b672-c2171674c104 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.053164 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5af851b6-8d31-4aeb-b672-c2171674c104 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.053622 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5af851b6-8d31-4aeb-b672-c2171674c104 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.054047 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5af851b6-8d31-4aeb-b672-c2171674c104 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.063926 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-83b24ad5-0c02-4fad-b744-412494c3fc19 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:11.072668 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-83b24ad5-0c02-4fad-b744-412494c3fc19 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.151553 Aug 24 12:35:11.073236 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 182/355] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:10 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:11.190236 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5af851b6-8d31-4aeb-b672-c2171674c104 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:11.198349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5af851b6-8d31-4aeb-b672-c2171674c104 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.158957 Aug 24 12:35:11.198914 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 174/356] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:11 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:11.221087 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7a97a5d0-57ad-44b3-9d5f-f1491f66f140 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:11.221691 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-7a97a5d0-57ad-44b3-9d5f-f1491f66f140 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:11.227595 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7a97a5d0-57ad-44b3-9d5f-f1491f66f140 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.228107 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7a97a5d0-57ad-44b3-9d5f-f1491f66f140 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.228542 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7a97a5d0-57ad-44b3-9d5f-f1491f66f140 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.229228 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7a97a5d0-57ad-44b3-9d5f-f1491f66f140 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.229682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7a97a5d0-57ad-44b3-9d5f-f1491f66f140 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.230103 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7a97a5d0-57ad-44b3-9d5f-f1491f66f140 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.368590 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-7a97a5d0-57ad-44b3-9d5f-f1491f66f140 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:11.377645 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-7a97a5d0-57ad-44b3-9d5f-f1491f66f140 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:11.379153 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-7a97a5d0-57ad-44b3-9d5f-f1491f66f140 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:11.380340 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-7a97a5d0-57ad-44b3-9d5f-f1491f66f140 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1722 microversion: 2.20 time: 0.163083 Aug 24 12:35:11.380899 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 183/357] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:11 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:12.093700 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-688ac8ca-fe66-464c-8039-d4d3e1ac8ca8 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:12.094324 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-688ac8ca-fe66-464c-8039-d4d3e1ac8ca8 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:12.102476 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-688ac8ca-fe66-464c-8039-d4d3e1ac8ca8 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.102963 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-688ac8ca-fe66-464c-8039-d4d3e1ac8ca8 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.103403 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-688ac8ca-fe66-464c-8039-d4d3e1ac8ca8 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.104130 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-688ac8ca-fe66-464c-8039-d4d3e1ac8ca8 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.104696 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-688ac8ca-fe66-464c-8039-d4d3e1ac8ca8 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.105149 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-688ac8ca-fe66-464c-8039-d4d3e1ac8ca8 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.220331 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9f9069df-c787-4360-bdc4-253c41fc5c9d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:12.220949 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9f9069df-c787-4360-bdc4-253c41fc5c9d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:12.227429 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9f9069df-c787-4360-bdc4-253c41fc5c9d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.227957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9f9069df-c787-4360-bdc4-253c41fc5c9d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.228393 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9f9069df-c787-4360-bdc4-253c41fc5c9d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.229178 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9f9069df-c787-4360-bdc4-253c41fc5c9d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.229593 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9f9069df-c787-4360-bdc4-253c41fc5c9d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.230052 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9f9069df-c787-4360-bdc4-253c41fc5c9d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.239018 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-688ac8ca-fe66-464c-8039-d4d3e1ac8ca8 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:12.246809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-688ac8ca-fe66-464c-8039-d4d3e1ac8ca8 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.157384 Aug 24 12:35:12.247871 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 175/358] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:12 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:12.365561 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9f9069df-c787-4360-bdc4-253c41fc5c9d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:12.373986 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9f9069df-c787-4360-bdc4-253c41fc5c9d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.158392 Aug 24 12:35:12.374545 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 184/359] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:12 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:12.404346 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ea43d96d-b176-422c-a0f2-0af4bca1ebc8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:12.404964 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ea43d96d-b176-422c-a0f2-0af4bca1ebc8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:12.410759 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea43d96d-b176-422c-a0f2-0af4bca1ebc8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.411271 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea43d96d-b176-422c-a0f2-0af4bca1ebc8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.411737 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea43d96d-b176-422c-a0f2-0af4bca1ebc8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.412427 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea43d96d-b176-422c-a0f2-0af4bca1ebc8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.412881 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea43d96d-b176-422c-a0f2-0af4bca1ebc8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.413308 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea43d96d-b176-422c-a0f2-0af4bca1ebc8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.547067 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ea43d96d-b176-422c-a0f2-0af4bca1ebc8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:12.555040 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ea43d96d-b176-422c-a0f2-0af4bca1ebc8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:12.556551 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ea43d96d-b176-422c-a0f2-0af4bca1ebc8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:12.557690 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ea43d96d-b176-422c-a0f2-0af4bca1ebc8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1722 microversion: 2.20 time: 0.157985 Aug 24 12:35:12.558242 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 176/360] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:12 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:13.267657 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-8f53a392-0ad5-4c43-815e-20801af46cae tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:13.268238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-8f53a392-0ad5-4c43-815e-20801af46cae tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:13.274781 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8f53a392-0ad5-4c43-815e-20801af46cae tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.275256 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8f53a392-0ad5-4c43-815e-20801af46cae tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.275711 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8f53a392-0ad5-4c43-815e-20801af46cae tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.276393 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8f53a392-0ad5-4c43-815e-20801af46cae tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.276838 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8f53a392-0ad5-4c43-815e-20801af46cae tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.277310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8f53a392-0ad5-4c43-815e-20801af46cae tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.395820 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-625c1c50-8e88-4ef8-a90e-1060abd58ba4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:13.396526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-625c1c50-8e88-4ef8-a90e-1060abd58ba4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:13.403861 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-625c1c50-8e88-4ef8-a90e-1060abd58ba4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.404425 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-625c1c50-8e88-4ef8-a90e-1060abd58ba4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.404843 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-625c1c50-8e88-4ef8-a90e-1060abd58ba4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.405462 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-625c1c50-8e88-4ef8-a90e-1060abd58ba4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.405912 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-625c1c50-8e88-4ef8-a90e-1060abd58ba4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.406335 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-625c1c50-8e88-4ef8-a90e-1060abd58ba4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.407739 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-8f53a392-0ad5-4c43-815e-20801af46cae tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:13.415312 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-8f53a392-0ad5-4c43-815e-20801af46cae tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.151764 Aug 24 12:35:13.416624 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 185/361] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:13 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:13.538951 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-625c1c50-8e88-4ef8-a90e-1060abd58ba4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:13.547156 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-625c1c50-8e88-4ef8-a90e-1060abd58ba4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.155205 Aug 24 12:35:13.547735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 177/362] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:13 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:13.581825 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a81222c8-4a4d-433f-bcba-2937bcf546cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:13.582434 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-a81222c8-4a4d-433f-bcba-2937bcf546cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:13.588438 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a81222c8-4a4d-433f-bcba-2937bcf546cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.588918 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a81222c8-4a4d-433f-bcba-2937bcf546cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.589351 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a81222c8-4a4d-433f-bcba-2937bcf546cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.590034 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a81222c8-4a4d-433f-bcba-2937bcf546cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.591214 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a81222c8-4a4d-433f-bcba-2937bcf546cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.591664 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a81222c8-4a4d-433f-bcba-2937bcf546cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.719225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-a81222c8-4a4d-433f-bcba-2937bcf546cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:13.727354 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-a81222c8-4a4d-433f-bcba-2937bcf546cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:13.728890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-a81222c8-4a4d-433f-bcba-2937bcf546cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:13.730041 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a81222c8-4a4d-433f-bcba-2937bcf546cd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1665 microversion: 2.20 time: 0.152153 Aug 24 12:35:13.730631 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 186/363] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:13 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:13.752721 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ae9bf97c-278c-4dfb-9713-353f1219cb0e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3867e945-5671-4ec1-bc0e-90aff8bf8371"}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:13.755138 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ae9bf97c-278c-4dfb-9713-353f1219cb0e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:13.761101 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ae9bf97c-278c-4dfb-9713-353f1219cb0e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.761585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ae9bf97c-278c-4dfb-9713-353f1219cb0e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.762027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ae9bf97c-278c-4dfb-9713-353f1219cb0e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.763341 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ae9bf97c-278c-4dfb-9713-353f1219cb0e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.763833 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ae9bf97c-278c-4dfb-9713-353f1219cb0e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.764263 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ae9bf97c-278c-4dfb-9713-353f1219cb0e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.043218 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ae9bf97c-278c-4dfb-9713-353f1219cb0e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "POST /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.294353 Aug 24 12:35:14.043779 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 178/364] 10.222.0.58 () {62 vars in 1364 bytes} [Wed Aug 24 12:35:13 2022] POST /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:35:14.167671 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-705c454f-1995-45cf-a879-52abea159380 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:14.168268 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-705c454f-1995-45cf-a879-52abea159380 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:14.175159 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-705c454f-1995-45cf-a879-52abea159380 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.175677 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-705c454f-1995-45cf-a879-52abea159380 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.176110 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-705c454f-1995-45cf-a879-52abea159380 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.176800 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-705c454f-1995-45cf-a879-52abea159380 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.177282 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-705c454f-1995-45cf-a879-52abea159380 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.177706 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-705c454f-1995-45cf-a879-52abea159380 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.222809 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-705c454f-1995-45cf-a879-52abea159380 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127308) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 12:35:14.291540 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-705c454f-1995-45cf-a879-52abea159380 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "POST /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/action" status: 202 len: 0 microversion: 2.20 time: 0.127670 Aug 24 12:35:14.292503 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 187/365] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 12:35:14 2022] POST /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:35:14.300982 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-58a04e44-c12a-4b5b-8275-67cce73c9bd8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:14.301722 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-58a04e44-c12a-4b5b-8275-67cce73c9bd8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:14.308265 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58a04e44-c12a-4b5b-8275-67cce73c9bd8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.308744 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58a04e44-c12a-4b5b-8275-67cce73c9bd8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.309821 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58a04e44-c12a-4b5b-8275-67cce73c9bd8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.310618 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58a04e44-c12a-4b5b-8275-67cce73c9bd8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.311074 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58a04e44-c12a-4b5b-8275-67cce73c9bd8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.311498 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58a04e44-c12a-4b5b-8275-67cce73c9bd8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.437545 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c084e008-c3c4-4962-8f1a-2374942429a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:14.438142 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c084e008-c3c4-4962-8f1a-2374942429a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:14.451167 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c084e008-c3c4-4962-8f1a-2374942429a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.455302 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-58a04e44-c12a-4b5b-8275-67cce73c9bd8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:14.458801 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c084e008-c3c4-4962-8f1a-2374942429a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.459258 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c084e008-c3c4-4962-8f1a-2374942429a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.460002 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c084e008-c3c4-4962-8f1a-2374942429a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.460453 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c084e008-c3c4-4962-8f1a-2374942429a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.461048 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c084e008-c3c4-4962-8f1a-2374942429a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.464134 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-58a04e44-c12a-4b5b-8275-67cce73c9bd8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:14.466430 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-58a04e44-c12a-4b5b-8275-67cce73c9bd8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:14.467654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-58a04e44-c12a-4b5b-8275-67cce73c9bd8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1751 microversion: 2.20 time: 0.170625 Aug 24 12:35:14.468200 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 179/366] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:14 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:14.568094 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-374a866a-a52c-4d55-83cd-1fa1c44afbdb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:14.568811 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-374a866a-a52c-4d55-83cd-1fa1c44afbdb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:14.575703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-374a866a-a52c-4d55-83cd-1fa1c44afbdb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.576294 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-374a866a-a52c-4d55-83cd-1fa1c44afbdb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.577072 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-374a866a-a52c-4d55-83cd-1fa1c44afbdb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.577896 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-374a866a-a52c-4d55-83cd-1fa1c44afbdb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.578539 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-374a866a-a52c-4d55-83cd-1fa1c44afbdb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.578973 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-374a866a-a52c-4d55-83cd-1fa1c44afbdb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.600396 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c084e008-c3c4-4962-8f1a-2374942429a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:14.609500 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c084e008-c3c4-4962-8f1a-2374942429a3 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.177075 Aug 24 12:35:14.610562 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 188/367] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:14 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:14.713235 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-374a866a-a52c-4d55-83cd-1fa1c44afbdb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:14.722012 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-374a866a-a52c-4d55-83cd-1fa1c44afbdb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.157832 Aug 24 12:35:14.722579 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 180/368] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:14 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:15.493659 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-6aad3af4-9d02-4682-8dec-8b033a7fc40e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:15.494324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-6aad3af4-9d02-4682-8dec-8b033a7fc40e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:15.501641 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6aad3af4-9d02-4682-8dec-8b033a7fc40e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.502127 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6aad3af4-9d02-4682-8dec-8b033a7fc40e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.502559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6aad3af4-9d02-4682-8dec-8b033a7fc40e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.503266 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6aad3af4-9d02-4682-8dec-8b033a7fc40e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.503765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6aad3af4-9d02-4682-8dec-8b033a7fc40e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.504189 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6aad3af4-9d02-4682-8dec-8b033a7fc40e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.629959 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c0d0b853-9d22-40e4-ae8b-082576f65871 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:15.630582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c0d0b853-9d22-40e4-ae8b-082576f65871 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:15.637256 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0d0b853-9d22-40e4-ae8b-082576f65871 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.637768 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0d0b853-9d22-40e4-ae8b-082576f65871 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.638195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0d0b853-9d22-40e4-ae8b-082576f65871 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.639250 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0d0b853-9d22-40e4-ae8b-082576f65871 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.639731 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0d0b853-9d22-40e4-ae8b-082576f65871 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.640387 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c0d0b853-9d22-40e4-ae8b-082576f65871 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.642263 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6aad3af4-9d02-4682-8dec-8b033a7fc40e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:15.652563 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6aad3af4-9d02-4682-8dec-8b033a7fc40e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:15.654452 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6aad3af4-9d02-4682-8dec-8b033a7fc40e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:15.655738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-6aad3af4-9d02-4682-8dec-8b033a7fc40e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1753 microversion: 2.20 time: 0.166117 Aug 24 12:35:15.656296 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 189/369] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:15 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:15.744657 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f82de3c9-7b98-426b-9a5d-d78215819cae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:15.745270 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f82de3c9-7b98-426b-9a5d-d78215819cae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:15.753121 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f82de3c9-7b98-426b-9a5d-d78215819cae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.753620 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f82de3c9-7b98-426b-9a5d-d78215819cae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.754058 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f82de3c9-7b98-426b-9a5d-d78215819cae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.754755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f82de3c9-7b98-426b-9a5d-d78215819cae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.755210 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f82de3c9-7b98-426b-9a5d-d78215819cae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.755655 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f82de3c9-7b98-426b-9a5d-d78215819cae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.773102 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c0d0b853-9d22-40e4-ae8b-082576f65871 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:15.775480 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:15.782334 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c0d0b853-9d22-40e4-ae8b-082576f65871 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.156201 Aug 24 12:35:15.782908 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 181/370] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:15 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:15.891298 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f82de3c9-7b98-426b-9a5d-d78215819cae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:15.899413 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f82de3c9-7b98-426b-9a5d-d78215819cae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.158828 Aug 24 12:35:15.900019 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 190/371] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:15 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:16.679425 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f3b9ea82-33f2-46e7-b5bf-70e22f40180b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:16.680061 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f3b9ea82-33f2-46e7-b5bf-70e22f40180b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:16.687839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3b9ea82-33f2-46e7-b5bf-70e22f40180b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:16.688333 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3b9ea82-33f2-46e7-b5bf-70e22f40180b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:16.688764 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3b9ea82-33f2-46e7-b5bf-70e22f40180b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:16.689455 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3b9ea82-33f2-46e7-b5bf-70e22f40180b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:16.689899 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3b9ea82-33f2-46e7-b5bf-70e22f40180b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:16.690323 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3b9ea82-33f2-46e7-b5bf-70e22f40180b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:16.803510 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-10ef212d-dcd2-4ee0-bcf3-3d801e5e59e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:16.804269 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-10ef212d-dcd2-4ee0-bcf3-3d801e5e59e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:16.811947 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-10ef212d-dcd2-4ee0-bcf3-3d801e5e59e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:16.812519 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-10ef212d-dcd2-4ee0-bcf3-3d801e5e59e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:16.813028 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-10ef212d-dcd2-4ee0-bcf3-3d801e5e59e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:16.813828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-10ef212d-dcd2-4ee0-bcf3-3d801e5e59e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:16.814389 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-10ef212d-dcd2-4ee0-bcf3-3d801e5e59e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:16.814935 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-10ef212d-dcd2-4ee0-bcf3-3d801e5e59e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:16.824283 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f3b9ea82-33f2-46e7-b5bf-70e22f40180b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:16.835366 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f3b9ea82-33f2-46e7-b5bf-70e22f40180b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:16.837287 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f3b9ea82-33f2-46e7-b5bf-70e22f40180b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:16.838476 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f3b9ea82-33f2-46e7-b5bf-70e22f40180b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.163033 Aug 24 12:35:16.839494 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 182/372] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:16 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:16.922376 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-fc42702c-684c-475c-a98e-aa89e80f7d33 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:16.923296 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-fc42702c-684c-475c-a98e-aa89e80f7d33 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:16.932068 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc42702c-684c-475c-a98e-aa89e80f7d33 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:16.932642 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc42702c-684c-475c-a98e-aa89e80f7d33 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:16.933144 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc42702c-684c-475c-a98e-aa89e80f7d33 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:16.934950 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc42702c-684c-475c-a98e-aa89e80f7d33 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:16.935780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc42702c-684c-475c-a98e-aa89e80f7d33 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:16.936710 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc42702c-684c-475c-a98e-aa89e80f7d33 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:16.981745 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-10ef212d-dcd2-4ee0-bcf3-3d801e5e59e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:16.995329 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-10ef212d-dcd2-4ee0-bcf3-3d801e5e59e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.195601 Aug 24 12:35:17.009584 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 191/373] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:16 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:17.094127 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-fc42702c-684c-475c-a98e-aa89e80f7d33 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:17.103978 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-fc42702c-684c-475c-a98e-aa89e80f7d33 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.186939 Aug 24 12:35:17.104764 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 183/374] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:16 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:17.862972 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-350dcf98-beb3-4f2f-bd11-67e3ee274239 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:17.863573 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-350dcf98-beb3-4f2f-bd11-67e3ee274239 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:17.869959 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-350dcf98-beb3-4f2f-bd11-67e3ee274239 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:17.870437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-350dcf98-beb3-4f2f-bd11-67e3ee274239 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:17.870869 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-350dcf98-beb3-4f2f-bd11-67e3ee274239 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:17.871552 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-350dcf98-beb3-4f2f-bd11-67e3ee274239 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:17.872029 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-350dcf98-beb3-4f2f-bd11-67e3ee274239 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:17.872450 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-350dcf98-beb3-4f2f-bd11-67e3ee274239 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.001995 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-350dcf98-beb3-4f2f-bd11-67e3ee274239 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:18.010455 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-350dcf98-beb3-4f2f-bd11-67e3ee274239 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:18.012607 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-350dcf98-beb3-4f2f-bd11-67e3ee274239 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:18.013964 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-350dcf98-beb3-4f2f-bd11-67e3ee274239 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.154935 Aug 24 12:35:18.014550 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 192/375] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:17 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:18.016802 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-05c4e2ac-a634-47ef-a03e-b794ce463328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:18.017422 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-05c4e2ac-a634-47ef-a03e-b794ce463328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:18.023924 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05c4e2ac-a634-47ef-a03e-b794ce463328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.024414 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05c4e2ac-a634-47ef-a03e-b794ce463328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.024865 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05c4e2ac-a634-47ef-a03e-b794ce463328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.025661 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05c4e2ac-a634-47ef-a03e-b794ce463328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.026115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05c4e2ac-a634-47ef-a03e-b794ce463328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.026543 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05c4e2ac-a634-47ef-a03e-b794ce463328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.125626 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a5a8bc1e-f6c2-46f4-b17c-9a9c1b971cb3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:18.126373 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-a5a8bc1e-f6c2-46f4-b17c-9a9c1b971cb3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:18.132223 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a5a8bc1e-f6c2-46f4-b17c-9a9c1b971cb3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.132785 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a5a8bc1e-f6c2-46f4-b17c-9a9c1b971cb3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.133227 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a5a8bc1e-f6c2-46f4-b17c-9a9c1b971cb3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.133952 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a5a8bc1e-f6c2-46f4-b17c-9a9c1b971cb3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.134403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a5a8bc1e-f6c2-46f4-b17c-9a9c1b971cb3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.134822 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a5a8bc1e-f6c2-46f4-b17c-9a9c1b971cb3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.155130 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-05c4e2ac-a634-47ef-a03e-b794ce463328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:18.162747 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-05c4e2ac-a634-47ef-a03e-b794ce463328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.149660 Aug 24 12:35:18.163312 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 184/376] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:18 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:18.265299 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-a5a8bc1e-f6c2-46f4-b17c-9a9c1b971cb3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:18.273388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a5a8bc1e-f6c2-46f4-b17c-9a9c1b971cb3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.151598 Aug 24 12:35:18.273978 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 193/377] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:18 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:19.037915 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c80b5654-14e2-430e-b718-5e96688f806b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:19.038524 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c80b5654-14e2-430e-b718-5e96688f806b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:19.040993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=100 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:19.047339 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c80b5654-14e2-430e-b718-5e96688f806b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:19.047930 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c80b5654-14e2-430e-b718-5e96688f806b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:19.048462 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c80b5654-14e2-430e-b718-5e96688f806b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:19.049258 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c80b5654-14e2-430e-b718-5e96688f806b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:19.049785 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c80b5654-14e2-430e-b718-5e96688f806b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:19.050289 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c80b5654-14e2-430e-b718-5e96688f806b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:19.183773 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-5819a8fe-edfa-49d9-b6f7-2a7986764d03 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:19.185457 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-5819a8fe-edfa-49d9-b6f7-2a7986764d03 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:19.191856 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5819a8fe-edfa-49d9-b6f7-2a7986764d03 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:19.192850 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5819a8fe-edfa-49d9-b6f7-2a7986764d03 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:19.193291 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5819a8fe-edfa-49d9-b6f7-2a7986764d03 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:19.193996 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5819a8fe-edfa-49d9-b6f7-2a7986764d03 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:19.194450 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5819a8fe-edfa-49d9-b6f7-2a7986764d03 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:19.194904 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5819a8fe-edfa-49d9-b6f7-2a7986764d03 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:19.195505 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c80b5654-14e2-430e-b718-5e96688f806b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:19.206253 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c80b5654-14e2-430e-b718-5e96688f806b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:19.207913 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c80b5654-14e2-430e-b718-5e96688f806b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:19.209421 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c80b5654-14e2-430e-b718-5e96688f806b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.175359 Aug 24 12:35:19.223649 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 185/378] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:19 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:19.295375 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0333f070-dff6-41af-b252-be95b6050e39 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:19.296090 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0333f070-dff6-41af-b252-be95b6050e39 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:19.302283 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0333f070-dff6-41af-b252-be95b6050e39 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:19.302865 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0333f070-dff6-41af-b252-be95b6050e39 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:19.303380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0333f070-dff6-41af-b252-be95b6050e39 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:19.304191 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0333f070-dff6-41af-b252-be95b6050e39 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:19.304743 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0333f070-dff6-41af-b252-be95b6050e39 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:19.305257 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0333f070-dff6-41af-b252-be95b6050e39 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:19.361575 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-5819a8fe-edfa-49d9-b6f7-2a7986764d03 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:19.371173 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-5819a8fe-edfa-49d9-b6f7-2a7986764d03 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.191149 Aug 24 12:35:19.372168 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 194/379] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:19 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:19.455791 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-0333f070-dff6-41af-b252-be95b6050e39 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:19.464129 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0333f070-dff6-41af-b252-be95b6050e39 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.173433 Aug 24 12:35:19.465213 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 186/380] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:19 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:20.234945 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-19e17f60-e5a0-460a-9fbf-80673c95dbd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:20.235470 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-19e17f60-e5a0-460a-9fbf-80673c95dbd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:20.241897 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-19e17f60-e5a0-460a-9fbf-80673c95dbd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.242370 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-19e17f60-e5a0-460a-9fbf-80673c95dbd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.242801 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-19e17f60-e5a0-460a-9fbf-80673c95dbd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.243490 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-19e17f60-e5a0-460a-9fbf-80673c95dbd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.243963 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-19e17f60-e5a0-460a-9fbf-80673c95dbd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.244382 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-19e17f60-e5a0-460a-9fbf-80673c95dbd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.385090 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-19e17f60-e5a0-460a-9fbf-80673c95dbd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:20.394356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-cb9bc0e4-3816-4e53-9429-cf7e808ea3bb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:20.395006 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-cb9bc0e4-3816-4e53-9429-cf7e808ea3bb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:20.400936 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-19e17f60-e5a0-460a-9fbf-80673c95dbd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:20.402872 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-19e17f60-e5a0-460a-9fbf-80673c95dbd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:20.404339 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-19e17f60-e5a0-460a-9fbf-80673c95dbd2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.173910 Aug 24 12:35:20.407642 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cb9bc0e4-3816-4e53-9429-cf7e808ea3bb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.408369 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cb9bc0e4-3816-4e53-9429-cf7e808ea3bb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.408974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cb9bc0e4-3816-4e53-9429-cf7e808ea3bb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.410035 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cb9bc0e4-3816-4e53-9429-cf7e808ea3bb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.410651 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cb9bc0e4-3816-4e53-9429-cf7e808ea3bb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.411239 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cb9bc0e4-3816-4e53-9429-cf7e808ea3bb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.423736 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 195/381] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:20 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:20.486235 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b200abd4-e5da-4099-803d-d7395bf890e4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:20.486754 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b200abd4-e5da-4099-803d-d7395bf890e4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:20.493242 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b200abd4-e5da-4099-803d-d7395bf890e4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.494001 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b200abd4-e5da-4099-803d-d7395bf890e4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.506399 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b200abd4-e5da-4099-803d-d7395bf890e4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.507474 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b200abd4-e5da-4099-803d-d7395bf890e4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.508348 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b200abd4-e5da-4099-803d-d7395bf890e4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.509072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b200abd4-e5da-4099-803d-d7395bf890e4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.911493 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-cb9bc0e4-3816-4e53-9429-cf7e808ea3bb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:20.926461 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b200abd4-e5da-4099-803d-d7395bf890e4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:20.927492 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-cb9bc0e4-3816-4e53-9429-cf7e808ea3bb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.536851 Aug 24 12:35:20.928106 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 187/382] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:20 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:20.939988 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b200abd4-e5da-4099-803d-d7395bf890e4 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.457523 Aug 24 12:35:20.940708 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 196/383] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:20 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:21.432261 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-65d267d7-fe50-44d0-9267-d1e5ca78a8bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:21.432955 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-65d267d7-fe50-44d0-9267-d1e5ca78a8bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:21.440767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-65d267d7-fe50-44d0-9267-d1e5ca78a8bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:21.441253 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-65d267d7-fe50-44d0-9267-d1e5ca78a8bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:21.441691 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-65d267d7-fe50-44d0-9267-d1e5ca78a8bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:21.442403 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-65d267d7-fe50-44d0-9267-d1e5ca78a8bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:21.442926 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-65d267d7-fe50-44d0-9267-d1e5ca78a8bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:21.443359 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-65d267d7-fe50-44d0-9267-d1e5ca78a8bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:21.583775 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-65d267d7-fe50-44d0-9267-d1e5ca78a8bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:21.592489 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-65d267d7-fe50-44d0-9267-d1e5ca78a8bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:21.593999 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-65d267d7-fe50-44d0-9267-d1e5ca78a8bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:21.595150 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-65d267d7-fe50-44d0-9267-d1e5ca78a8bd tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.167004 Aug 24 12:35:21.595812 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 188/384] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:21 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:21.948401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ba867c77-eeb7-4be7-9200-122c8a6c1a7b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:21.949015 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-ba867c77-eeb7-4be7-9200-122c8a6c1a7b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:21.956017 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ba867c77-eeb7-4be7-9200-122c8a6c1a7b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:21.956505 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ba867c77-eeb7-4be7-9200-122c8a6c1a7b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:21.956937 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ba867c77-eeb7-4be7-9200-122c8a6c1a7b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:21.957770 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ba867c77-eeb7-4be7-9200-122c8a6c1a7b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:21.958393 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ba867c77-eeb7-4be7-9200-122c8a6c1a7b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:21.958967 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ba867c77-eeb7-4be7-9200-122c8a6c1a7b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:21.962229 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-cb731e42-b7a3-4a54-91c9-0ac9ebe3c1e1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:21.962853 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-cb731e42-b7a3-4a54-91c9-0ac9ebe3c1e1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:21.963672 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:21.970260 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cb731e42-b7a3-4a54-91c9-0ac9ebe3c1e1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:21.970768 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cb731e42-b7a3-4a54-91c9-0ac9ebe3c1e1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:21.971209 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cb731e42-b7a3-4a54-91c9-0ac9ebe3c1e1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:21.974616 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cb731e42-b7a3-4a54-91c9-0ac9ebe3c1e1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:21.975129 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cb731e42-b7a3-4a54-91c9-0ac9ebe3c1e1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:21.975574 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cb731e42-b7a3-4a54-91c9-0ac9ebe3c1e1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:22.185927 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-cb731e42-b7a3-4a54-91c9-0ac9ebe3c1e1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:22.188219 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ba867c77-eeb7-4be7-9200-122c8a6c1a7b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:22.195752 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-cb731e42-b7a3-4a54-91c9-0ac9ebe3c1e1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.237216 Aug 24 12:35:22.196645 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 189/385] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:21 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:22.196759 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-ba867c77-eeb7-4be7-9200-122c8a6c1a7b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.251902 Aug 24 12:35:22.197273 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 197/386] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:21 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:22.521038 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-9029bdce-361a-472f-8f06-2dde454c440b req-4f65fa0f-3014-4edc-8427-4273d741ee79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab4d787-eab3-4654-8d9c-b7a7f10972ca", "name": "network-vif-plugged", "status": "completed", "tag": "0d661b8c-9ce8-4cb3-aeff-26f9ef9ed93e"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:22.532838 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-9029bdce-361a-472f-8f06-2dde454c440b req-4f65fa0f-3014-4edc-8427-4273d741ee79 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:22.533590 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-9029bdce-361a-472f-8f06-2dde454c440b req-4f65fa0f-3014-4edc-8427-4273d741ee79 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:22.534318 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-9029bdce-361a-472f-8f06-2dde454c440b req-4f65fa0f-3014-4edc-8427-4273d741ee79 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:22.548821 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-9029bdce-361a-472f-8f06-2dde454c440b req-4f65fa0f-3014-4edc-8427-4273d741ee79 service nova] Creating event network-vif-plugged:0d661b8c-9ce8-4cb3-aeff-26f9ef9ed93e for instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca on hv-cinder-84890 Aug 24 12:35:22.561943 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-9029bdce-361a-472f-8f06-2dde454c440b req-4f65fa0f-3014-4edc-8427-4273d741ee79 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044360 Aug 24 12:35:22.562893 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 190/387] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:22.619104 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f86713fc-050b-4afb-b488-b4a335410396 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:22.619735 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f86713fc-050b-4afb-b488-b4a335410396 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:22.626042 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f86713fc-050b-4afb-b488-b4a335410396 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:22.626528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f86713fc-050b-4afb-b488-b4a335410396 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:22.626955 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f86713fc-050b-4afb-b488-b4a335410396 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:22.627684 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f86713fc-050b-4afb-b488-b4a335410396 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:22.628121 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f86713fc-050b-4afb-b488-b4a335410396 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:22.628539 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f86713fc-050b-4afb-b488-b4a335410396 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:22.763940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f86713fc-050b-4afb-b488-b4a335410396 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:22.772969 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f86713fc-050b-4afb-b488-b4a335410396 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:22.774582 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f86713fc-050b-4afb-b488-b4a335410396 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:22.775885 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f86713fc-050b-4afb-b488-b4a335410396 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.161465 Aug 24 12:35:22.776519 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 198/388] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:22 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:23.217591 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-0ee54b82-3b11-4492-ba8a-6c95e9e33a7a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:23.218267 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-0ee54b82-3b11-4492-ba8a-6c95e9e33a7a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:23.218378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8c031b28-b3d4-410f-ab24-2f0e902e2e11 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:23.219080 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8c031b28-b3d4-410f-ab24-2f0e902e2e11 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:23.225011 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0ee54b82-3b11-4492-ba8a-6c95e9e33a7a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:23.225488 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c031b28-b3d4-410f-ab24-2f0e902e2e11 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:23.225920 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0ee54b82-3b11-4492-ba8a-6c95e9e33a7a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:23.226102 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c031b28-b3d4-410f-ab24-2f0e902e2e11 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:23.226531 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0ee54b82-3b11-4492-ba8a-6c95e9e33a7a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:23.226656 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c031b28-b3d4-410f-ab24-2f0e902e2e11 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:23.227228 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0ee54b82-3b11-4492-ba8a-6c95e9e33a7a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:23.227364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c031b28-b3d4-410f-ab24-2f0e902e2e11 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:23.227697 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0ee54b82-3b11-4492-ba8a-6c95e9e33a7a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:23.228136 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c031b28-b3d4-410f-ab24-2f0e902e2e11 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:23.228560 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0ee54b82-3b11-4492-ba8a-6c95e9e33a7a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:23.228679 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c031b28-b3d4-410f-ab24-2f0e902e2e11 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:23.441725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8c031b28-b3d4-410f-ab24-2f0e902e2e11 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:23.448203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-0ee54b82-3b11-4492-ba8a-6c95e9e33a7a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:23.450428 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8c031b28-b3d4-410f-ab24-2f0e902e2e11 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.236371 Aug 24 12:35:23.451449 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 191/389] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:23 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:23.461223 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-0ee54b82-3b11-4492-ba8a-6c95e9e33a7a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.247515 Aug 24 12:35:23.461982 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 199/390] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:23 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:23.799388 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a7e83c2a-5bbb-444b-a77d-a41a59003d3c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:23.800227 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a7e83c2a-5bbb-444b-a77d-a41a59003d3c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:23.806816 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7e83c2a-5bbb-444b-a77d-a41a59003d3c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:23.807371 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7e83c2a-5bbb-444b-a77d-a41a59003d3c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:23.807906 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7e83c2a-5bbb-444b-a77d-a41a59003d3c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:23.808673 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7e83c2a-5bbb-444b-a77d-a41a59003d3c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:23.809217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7e83c2a-5bbb-444b-a77d-a41a59003d3c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:23.809851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a7e83c2a-5bbb-444b-a77d-a41a59003d3c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:23.953547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a7e83c2a-5bbb-444b-a77d-a41a59003d3c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:23.963107 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a7e83c2a-5bbb-444b-a77d-a41a59003d3c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:23.964641 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a7e83c2a-5bbb-444b-a77d-a41a59003d3c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:23.966392 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a7e83c2a-5bbb-444b-a77d-a41a59003d3c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.171051 Aug 24 12:35:23.967099 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 192/391] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:23 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:24.471789 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-6db7d611-9e7a-4dca-86b0-522070c07bf7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:24.472526 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-6db7d611-9e7a-4dca-86b0-522070c07bf7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:24.479515 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6db7d611-9e7a-4dca-86b0-522070c07bf7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:24.480075 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6db7d611-9e7a-4dca-86b0-522070c07bf7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:24.480511 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6db7d611-9e7a-4dca-86b0-522070c07bf7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:24.481263 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6db7d611-9e7a-4dca-86b0-522070c07bf7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:24.481710 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6db7d611-9e7a-4dca-86b0-522070c07bf7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:24.482127 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6db7d611-9e7a-4dca-86b0-522070c07bf7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:24.482658 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6db98514-cc2c-49ab-ac62-74c4f50ee429 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:24.483476 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-6db98514-cc2c-49ab-ac62-74c4f50ee429 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:24.490110 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6db98514-cc2c-49ab-ac62-74c4f50ee429 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:24.490611 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6db98514-cc2c-49ab-ac62-74c4f50ee429 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:24.491052 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6db98514-cc2c-49ab-ac62-74c4f50ee429 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:24.491852 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6db98514-cc2c-49ab-ac62-74c4f50ee429 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:24.492358 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6db98514-cc2c-49ab-ac62-74c4f50ee429 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:24.492745 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6db98514-cc2c-49ab-ac62-74c4f50ee429 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:24.716277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6db98514-cc2c-49ab-ac62-74c4f50ee429 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:24.719935 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6db7d611-9e7a-4dca-86b0-522070c07bf7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:24.727003 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-6db98514-cc2c-49ab-ac62-74c4f50ee429 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.248188 Aug 24 12:35:24.727924 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-6db7d611-9e7a-4dca-86b0-522070c07bf7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.259984 Aug 24 12:35:24.728375 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 193/392] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:24 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:24.734274 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 200/393] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:24 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:24.989832 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5e5e5c5a-84a3-400b-b949-b5b0f8beb7f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:24.990398 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5e5e5c5a-84a3-400b-b949-b5b0f8beb7f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:24.997364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5e5e5c5a-84a3-400b-b949-b5b0f8beb7f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:24.997855 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5e5e5c5a-84a3-400b-b949-b5b0f8beb7f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:24.998294 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5e5e5c5a-84a3-400b-b949-b5b0f8beb7f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:24.998996 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5e5e5c5a-84a3-400b-b949-b5b0f8beb7f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:24.999450 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5e5e5c5a-84a3-400b-b949-b5b0f8beb7f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:25.000058 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5e5e5c5a-84a3-400b-b949-b5b0f8beb7f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:25.145603 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5e5e5c5a-84a3-400b-b949-b5b0f8beb7f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:25.155010 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5e5e5c5a-84a3-400b-b949-b5b0f8beb7f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:25.156490 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5e5e5c5a-84a3-400b-b949-b5b0f8beb7f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:25.157691 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5e5e5c5a-84a3-400b-b949-b5b0f8beb7f3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.171902 Aug 24 12:35:25.158244 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 194/394] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:24 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:25.749604 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-747fb58f-903e-4fd4-a2de-6db36bbf4a38 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:25.749843 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-30ff7513-e9f8-424d-9632-998ad8ffdd22 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:25.750317 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-747fb58f-903e-4fd4-a2de-6db36bbf4a38 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:25.750412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-30ff7513-e9f8-424d-9632-998ad8ffdd22 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:25.756497 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-747fb58f-903e-4fd4-a2de-6db36bbf4a38 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:25.756998 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-747fb58f-903e-4fd4-a2de-6db36bbf4a38 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:25.757140 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-30ff7513-e9f8-424d-9632-998ad8ffdd22 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:25.757474 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-30ff7513-e9f8-424d-9632-998ad8ffdd22 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:25.758168 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-30ff7513-e9f8-424d-9632-998ad8ffdd22 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:25.759097 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-30ff7513-e9f8-424d-9632-998ad8ffdd22 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:25.759550 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-30ff7513-e9f8-424d-9632-998ad8ffdd22 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:25.760028 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-30ff7513-e9f8-424d-9632-998ad8ffdd22 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:25.760522 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-747fb58f-903e-4fd4-a2de-6db36bbf4a38 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:25.761335 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-747fb58f-903e-4fd4-a2de-6db36bbf4a38 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:25.761883 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-747fb58f-903e-4fd4-a2de-6db36bbf4a38 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:25.762835 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-747fb58f-903e-4fd4-a2de-6db36bbf4a38 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:25.972100 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-30ff7513-e9f8-424d-9632-998ad8ffdd22 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:25.981580 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-747fb58f-903e-4fd4-a2de-6db36bbf4a38 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:25.984124 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-30ff7513-e9f8-424d-9632-998ad8ffdd22 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.237073 Aug 24 12:35:25.985387 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 201/395] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:25 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:25.989798 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-747fb58f-903e-4fd4-a2de-6db36bbf4a38 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.244543 Aug 24 12:35:25.990364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 195/396] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:25 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:26.181744 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d4b5322f-c933-4f6a-a7b1-419d71f6069c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:26.182367 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d4b5322f-c933-4f6a-a7b1-419d71f6069c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:26.188990 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d4b5322f-c933-4f6a-a7b1-419d71f6069c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:26.189604 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d4b5322f-c933-4f6a-a7b1-419d71f6069c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:26.190119 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d4b5322f-c933-4f6a-a7b1-419d71f6069c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:26.190894 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d4b5322f-c933-4f6a-a7b1-419d71f6069c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:26.191349 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d4b5322f-c933-4f6a-a7b1-419d71f6069c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:26.191941 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d4b5322f-c933-4f6a-a7b1-419d71f6069c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:26.337257 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d4b5322f-c933-4f6a-a7b1-419d71f6069c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:26.346462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d4b5322f-c933-4f6a-a7b1-419d71f6069c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:26.347995 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d4b5322f-c933-4f6a-a7b1-419d71f6069c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:26.349383 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d4b5322f-c933-4f6a-a7b1-419d71f6069c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.171618 Aug 24 12:35:26.350043 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 202/397] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:26 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:27.005920 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-94bbcee0-e2de-4f37-8abb-e97589331076 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:27.006551 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-94bbcee0-e2de-4f37-8abb-e97589331076 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:27.009968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2c322232-4996-4c1e-8726-545fbf96ae92 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:27.010721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2c322232-4996-4c1e-8726-545fbf96ae92 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:27.014037 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-94bbcee0-e2de-4f37-8abb-e97589331076 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:27.014545 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-94bbcee0-e2de-4f37-8abb-e97589331076 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:27.014993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-94bbcee0-e2de-4f37-8abb-e97589331076 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:27.015904 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-94bbcee0-e2de-4f37-8abb-e97589331076 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:27.016253 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-94bbcee0-e2de-4f37-8abb-e97589331076 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:27.016676 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-94bbcee0-e2de-4f37-8abb-e97589331076 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:27.017323 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c322232-4996-4c1e-8726-545fbf96ae92 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:27.017811 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c322232-4996-4c1e-8726-545fbf96ae92 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:27.018247 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c322232-4996-4c1e-8726-545fbf96ae92 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:27.018952 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c322232-4996-4c1e-8726-545fbf96ae92 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:27.019408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c322232-4996-4c1e-8726-545fbf96ae92 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:27.019856 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c322232-4996-4c1e-8726-545fbf96ae92 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:27.220543 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2c322232-4996-4c1e-8726-545fbf96ae92 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:27.228894 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2c322232-4996-4c1e-8726-545fbf96ae92 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.222202 Aug 24 12:35:27.229104 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 203/398] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:27 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:27.237019 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-94bbcee0-e2de-4f37-8abb-e97589331076 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:27.246049 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-94bbcee0-e2de-4f37-8abb-e97589331076 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.243978 Aug 24 12:35:27.246773 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 196/399] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:27 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:27.374842 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-85124c95-a87a-43b5-9c4f-4aa2f2f73169 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:27.375448 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-85124c95-a87a-43b5-9c4f-4aa2f2f73169 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:27.381443 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85124c95-a87a-43b5-9c4f-4aa2f2f73169 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:27.381925 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85124c95-a87a-43b5-9c4f-4aa2f2f73169 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:27.382437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85124c95-a87a-43b5-9c4f-4aa2f2f73169 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:27.383196 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85124c95-a87a-43b5-9c4f-4aa2f2f73169 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:27.383668 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85124c95-a87a-43b5-9c4f-4aa2f2f73169 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:27.384087 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85124c95-a87a-43b5-9c4f-4aa2f2f73169 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:27.516940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-85124c95-a87a-43b5-9c4f-4aa2f2f73169 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:27.526372 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-85124c95-a87a-43b5-9c4f-4aa2f2f73169 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:27.529995 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-85124c95-a87a-43b5-9c4f-4aa2f2f73169 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:27.531267 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-85124c95-a87a-43b5-9c4f-4aa2f2f73169 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.160872 Aug 24 12:35:27.531856 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 204/400] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:27 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:28.250238 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-1acc0b58-479b-4c70-bd11-9f775d5d90e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:28.251529 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-1acc0b58-479b-4c70-bd11-9f775d5d90e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:28.257677 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1acc0b58-479b-4c70-bd11-9f775d5d90e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.258173 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1acc0b58-479b-4c70-bd11-9f775d5d90e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.258617 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1acc0b58-479b-4c70-bd11-9f775d5d90e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.259337 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1acc0b58-479b-4c70-bd11-9f775d5d90e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.259821 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1acc0b58-479b-4c70-bd11-9f775d5d90e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.260247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1acc0b58-479b-4c70-bd11-9f775d5d90e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.270599 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-339abfbd-7e5c-43c2-a25b-4a07d2bf1316 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:28.271422 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-339abfbd-7e5c-43c2-a25b-4a07d2bf1316 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:28.278645 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-339abfbd-7e5c-43c2-a25b-4a07d2bf1316 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.279131 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-339abfbd-7e5c-43c2-a25b-4a07d2bf1316 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.279563 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-339abfbd-7e5c-43c2-a25b-4a07d2bf1316 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.280295 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-339abfbd-7e5c-43c2-a25b-4a07d2bf1316 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.280745 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-339abfbd-7e5c-43c2-a25b-4a07d2bf1316 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.281162 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-339abfbd-7e5c-43c2-a25b-4a07d2bf1316 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.474838 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-1acc0b58-479b-4c70-bd11-9f775d5d90e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:28.478807 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-339abfbd-7e5c-43c2-a25b-4a07d2bf1316 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:28.482609 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-1acc0b58-479b-4c70-bd11-9f775d5d90e6 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.236876 Aug 24 12:35:28.483179 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 197/401] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:28 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:28.487189 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-339abfbd-7e5c-43c2-a25b-4a07d2bf1316 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1721 microversion: 2.1 time: 0.221577 Aug 24 12:35:28.487836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 205/402] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:28 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:28.555481 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-450092b9-926d-421f-85e7-c6d4d2237595 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:28.556112 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-450092b9-926d-421f-85e7-c6d4d2237595 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:28.562533 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-450092b9-926d-421f-85e7-c6d4d2237595 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.563075 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-450092b9-926d-421f-85e7-c6d4d2237595 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.563587 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-450092b9-926d-421f-85e7-c6d4d2237595 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.564332 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-450092b9-926d-421f-85e7-c6d4d2237595 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.564783 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-450092b9-926d-421f-85e7-c6d4d2237595 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.565269 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-450092b9-926d-421f-85e7-c6d4d2237595 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.706726 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-450092b9-926d-421f-85e7-c6d4d2237595 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:28.716082 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-450092b9-926d-421f-85e7-c6d4d2237595 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:28.717591 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-450092b9-926d-421f-85e7-c6d4d2237595 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:28.718754 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-450092b9-926d-421f-85e7-c6d4d2237595 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.167253 Aug 24 12:35:28.719307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 198/403] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:28 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:29.503243 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-cdd6f4c7-4ab1-41c5-85b7-2f2ccf3a67bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:29.503886 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-cdd6f4c7-4ab1-41c5-85b7-2f2ccf3a67bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:29.508167 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-31b389fe-e628-4bcb-a908-e8dbb2b2ea60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:29.508781 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-31b389fe-e628-4bcb-a908-e8dbb2b2ea60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:29.510437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cdd6f4c7-4ab1-41c5-85b7-2f2ccf3a67bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:29.510922 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cdd6f4c7-4ab1-41c5-85b7-2f2ccf3a67bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:29.511355 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cdd6f4c7-4ab1-41c5-85b7-2f2ccf3a67bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:29.512279 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cdd6f4c7-4ab1-41c5-85b7-2f2ccf3a67bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:29.512738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cdd6f4c7-4ab1-41c5-85b7-2f2ccf3a67bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:29.513158 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cdd6f4c7-4ab1-41c5-85b7-2f2ccf3a67bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:29.515239 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31b389fe-e628-4bcb-a908-e8dbb2b2ea60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:29.515748 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31b389fe-e628-4bcb-a908-e8dbb2b2ea60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:29.516184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31b389fe-e628-4bcb-a908-e8dbb2b2ea60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:29.516870 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31b389fe-e628-4bcb-a908-e8dbb2b2ea60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:29.517318 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31b389fe-e628-4bcb-a908-e8dbb2b2ea60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:29.517737 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31b389fe-e628-4bcb-a908-e8dbb2b2ea60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:29.520464 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=100 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:29.706280 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cdd6f4c7-4ab1-41c5-85b7-2f2ccf3a67bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:29.714418 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-cdd6f4c7-4ab1-41c5-85b7-2f2ccf3a67bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.215043 Aug 24 12:35:29.719898 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 206/404] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:29 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:29.720012 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-31b389fe-e628-4bcb-a908-e8dbb2b2ea60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:29.726651 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-31b389fe-e628-4bcb-a908-e8dbb2b2ea60 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1698 microversion: 2.1 time: 0.222496 Aug 24 12:35:29.727213 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 199/405] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:29 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1698 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:29.741657 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-48e11031-26e8-440d-9aed-1ed525c933ba tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:29.742474 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-48e11031-26e8-440d-9aed-1ed525c933ba tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:29.747935 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-1c163f4b-0433-42d4-9ad6-d21a0fb8fe09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:29.748751 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-48e11031-26e8-440d-9aed-1ed525c933ba tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:29.749237 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-48e11031-26e8-440d-9aed-1ed525c933ba tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:29.749669 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-48e11031-26e8-440d-9aed-1ed525c933ba tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:29.750358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-48e11031-26e8-440d-9aed-1ed525c933ba tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:29.750812 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-48e11031-26e8-440d-9aed-1ed525c933ba tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:29.751227 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-48e11031-26e8-440d-9aed-1ed525c933ba tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:29.754048 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1c163f4b-0433-42d4-9ad6-d21a0fb8fe09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:29.754530 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1c163f4b-0433-42d4-9ad6-d21a0fb8fe09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:29.754964 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1c163f4b-0433-42d4-9ad6-d21a0fb8fe09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:29.826176 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-1c163f4b-0433-42d4-9ad6-d21a0fb8fe09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Going to try to start instance {{(pid=127307) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 12:35:29.871779 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-1c163f4b-0433-42d4-9ad6-d21a0fb8fe09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "POST /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/action" status: 202 len: 0 microversion: 2.1 time: 0.127297 Aug 24 12:35:29.872406 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 200/406] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 12:35:29 2022] POST /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:35:29.880913 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c1c3583a-3443-48e5-99a5-e7fd0b2a4e96 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:29.881609 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c1c3583a-3443-48e5-99a5-e7fd0b2a4e96 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:29.888664 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c1c3583a-3443-48e5-99a5-e7fd0b2a4e96 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:29.888936 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c1c3583a-3443-48e5-99a5-e7fd0b2a4e96 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:29.889371 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c1c3583a-3443-48e5-99a5-e7fd0b2a4e96 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:29.890077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c1c3583a-3443-48e5-99a5-e7fd0b2a4e96 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:29.890530 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c1c3583a-3443-48e5-99a5-e7fd0b2a4e96 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:29.890953 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c1c3583a-3443-48e5-99a5-e7fd0b2a4e96 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:29.897801 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-48e11031-26e8-440d-9aed-1ed525c933ba tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:29.906921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-48e11031-26e8-440d-9aed-1ed525c933ba tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:29.908438 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-48e11031-26e8-440d-9aed-1ed525c933ba tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:29.909609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-48e11031-26e8-440d-9aed-1ed525c933ba tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.171943 Aug 24 12:35:29.910172 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 207/407] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:29 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:30.020329 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c1c3583a-3443-48e5-99a5-e7fd0b2a4e96 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:30.029217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c1c3583a-3443-48e5-99a5-e7fd0b2a4e96 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1707 microversion: 2.1 time: 0.152411 Aug 24 12:35:30.029782 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 201/408] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:29 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1707 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:30.734626 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-271ae151-c420-4f20-ba90-0aaf82f847ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:30.735242 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-271ae151-c420-4f20-ba90-0aaf82f847ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:30.741593 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-271ae151-c420-4f20-ba90-0aaf82f847ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.742067 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-271ae151-c420-4f20-ba90-0aaf82f847ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.742495 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-271ae151-c420-4f20-ba90-0aaf82f847ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.743165 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-271ae151-c420-4f20-ba90-0aaf82f847ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.743609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-271ae151-c420-4f20-ba90-0aaf82f847ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.744043 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-271ae151-c420-4f20-ba90-0aaf82f847ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.883463 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-271ae151-c420-4f20-ba90-0aaf82f847ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:30.892358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-271ae151-c420-4f20-ba90-0aaf82f847ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1265 microversion: 2.1 time: 0.161549 Aug 24 12:35:30.892924 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 208/409] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:30 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:30.932672 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-be4f5136-2dc9-406b-9987-d9896a5151a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:30.933318 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-be4f5136-2dc9-406b-9987-d9896a5151a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:30.939870 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-be4f5136-2dc9-406b-9987-d9896a5151a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.940357 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-be4f5136-2dc9-406b-9987-d9896a5151a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.940794 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-be4f5136-2dc9-406b-9987-d9896a5151a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.941485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-be4f5136-2dc9-406b-9987-d9896a5151a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.941936 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-be4f5136-2dc9-406b-9987-d9896a5151a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.942360 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-be4f5136-2dc9-406b-9987-d9896a5151a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:31.051076 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-40b1d1cb-1d70-46f3-b49d-fb9c11b205b6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:31.052071 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-40b1d1cb-1d70-46f3-b49d-fb9c11b205b6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:31.054020 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:31.059883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-40b1d1cb-1d70-46f3-b49d-fb9c11b205b6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:31.060586 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-40b1d1cb-1d70-46f3-b49d-fb9c11b205b6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:31.061165 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-40b1d1cb-1d70-46f3-b49d-fb9c11b205b6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:31.062244 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-40b1d1cb-1d70-46f3-b49d-fb9c11b205b6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:31.062789 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-40b1d1cb-1d70-46f3-b49d-fb9c11b205b6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:31.063327 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-40b1d1cb-1d70-46f3-b49d-fb9c11b205b6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:31.073734 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-be4f5136-2dc9-406b-9987-d9896a5151a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:31.083254 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-be4f5136-2dc9-406b-9987-d9896a5151a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:31.084949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-be4f5136-2dc9-406b-9987-d9896a5151a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:31.086103 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-be4f5136-2dc9-406b-9987-d9896a5151a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.157299 Aug 24 12:35:31.086656 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 202/410] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:30 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:31.195779 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-40b1d1cb-1d70-46f3-b49d-fb9c11b205b6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:31.205122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-40b1d1cb-1d70-46f3-b49d-fb9c11b205b6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1707 microversion: 2.1 time: 0.158725 Aug 24 12:35:31.205682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 209/411] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:31 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1707 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:31.913865 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e2611ecb-1374-4a9c-b2da-ffb509145884 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:31.914479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e2611ecb-1374-4a9c-b2da-ffb509145884 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:31.921517 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e2611ecb-1374-4a9c-b2da-ffb509145884 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:31.922005 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e2611ecb-1374-4a9c-b2da-ffb509145884 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:31.922446 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e2611ecb-1374-4a9c-b2da-ffb509145884 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:31.923140 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e2611ecb-1374-4a9c-b2da-ffb509145884 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:31.923597 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e2611ecb-1374-4a9c-b2da-ffb509145884 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:31.924052 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e2611ecb-1374-4a9c-b2da-ffb509145884 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:32.056572 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e2611ecb-1374-4a9c-b2da-ffb509145884 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:32.064239 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e2611ecb-1374-4a9c-b2da-ffb509145884 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1453 microversion: 2.1 time: 0.154336 Aug 24 12:35:32.064804 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 203/412] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:31 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:32.085480 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-201a2bfb-e86c-4f56-bfde-463fdc1eb31a tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:32.086099 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-201a2bfb-e86c-4f56-bfde-463fdc1eb31a tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:32.092967 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-201a2bfb-e86c-4f56-bfde-463fdc1eb31a tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:32.093440 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-201a2bfb-e86c-4f56-bfde-463fdc1eb31a tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:32.093870 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-201a2bfb-e86c-4f56-bfde-463fdc1eb31a tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:32.094539 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-201a2bfb-e86c-4f56-bfde-463fdc1eb31a tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:32.094984 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-201a2bfb-e86c-4f56-bfde-463fdc1eb31a tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:32.095396 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-201a2bfb-e86c-4f56-bfde-463fdc1eb31a tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:32.109095 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ed146879-29b1-4424-b9c6-4d8270ef51d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:32.109742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ed146879-29b1-4424-b9c6-4d8270ef51d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:32.115676 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ed146879-29b1-4424-b9c6-4d8270ef51d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:32.116171 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ed146879-29b1-4424-b9c6-4d8270ef51d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:32.116612 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ed146879-29b1-4424-b9c6-4d8270ef51d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:32.117308 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ed146879-29b1-4424-b9c6-4d8270ef51d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:32.117765 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ed146879-29b1-4424-b9c6-4d8270ef51d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:32.118195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ed146879-29b1-4424-b9c6-4d8270ef51d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:32.290566 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-201a2bfb-e86c-4f56-bfde-463fdc1eb31a tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:32.297374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ed146879-29b1-4424-b9c6-4d8270ef51d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:32.298681 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-201a2bfb-e86c-4f56-bfde-463fdc1eb31a tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1453 microversion: 2.1 time: 0.217016 Aug 24 12:35:32.299252 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 210/413] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:32 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1453 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:32.303780 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e6efbcf7-e0fd-4b55-bd3d-bde3146d8fc8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:32.304602 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e6efbcf7-e0fd-4b55-bd3d-bde3146d8fc8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:32.309635 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ed146879-29b1-4424-b9c6-4d8270ef51d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:32.310207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e6efbcf7-e0fd-4b55-bd3d-bde3146d8fc8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:32.310693 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e6efbcf7-e0fd-4b55-bd3d-bde3146d8fc8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:32.311118 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e6efbcf7-e0fd-4b55-bd3d-bde3146d8fc8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:32.311237 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ed146879-29b1-4424-b9c6-4d8270ef51d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:32.311826 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e6efbcf7-e0fd-4b55-bd3d-bde3146d8fc8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:32.312272 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e6efbcf7-e0fd-4b55-bd3d-bde3146d8fc8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:32.312405 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ed146879-29b1-4424-b9c6-4d8270ef51d7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.207037 Aug 24 12:35:32.312690 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e6efbcf7-e0fd-4b55-bd3d-bde3146d8fc8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:32.314746 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 204/414] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:32 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:32.451230 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e6efbcf7-e0fd-4b55-bd3d-bde3146d8fc8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:32.459549 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e6efbcf7-e0fd-4b55-bd3d-bde3146d8fc8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1707 microversion: 2.1 time: 0.159143 Aug 24 12:35:32.460224 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 211/415] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:32 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1707 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:33.337805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-dee4cf82-fc1f-43a4-9584-8251eaeb52a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:33.338428 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-dee4cf82-fc1f-43a4-9584-8251eaeb52a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:33.345330 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dee4cf82-fc1f-43a4-9584-8251eaeb52a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.346850 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dee4cf82-fc1f-43a4-9584-8251eaeb52a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.346850 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dee4cf82-fc1f-43a4-9584-8251eaeb52a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.347061 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dee4cf82-fc1f-43a4-9584-8251eaeb52a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.347390 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dee4cf82-fc1f-43a4-9584-8251eaeb52a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.347845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dee4cf82-fc1f-43a4-9584-8251eaeb52a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.481370 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c0678344-48ab-442e-8739-2d5e28d6c0b1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:33.482075 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c0678344-48ab-442e-8739-2d5e28d6c0b1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:33.488588 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c0678344-48ab-442e-8739-2d5e28d6c0b1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.489072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c0678344-48ab-442e-8739-2d5e28d6c0b1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.489496 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c0678344-48ab-442e-8739-2d5e28d6c0b1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.490178 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c0678344-48ab-442e-8739-2d5e28d6c0b1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.490622 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c0678344-48ab-442e-8739-2d5e28d6c0b1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.491035 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c0678344-48ab-442e-8739-2d5e28d6c0b1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.586099 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-dee4cf82-fc1f-43a4-9584-8251eaeb52a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:33.595366 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-dee4cf82-fc1f-43a4-9584-8251eaeb52a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:33.596917 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-dee4cf82-fc1f-43a4-9584-8251eaeb52a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:33.598069 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-dee4cf82-fc1f-43a4-9584-8251eaeb52a4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.264213 Aug 24 12:35:33.598711 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 205/416] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:33 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:33.727594 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c0678344-48ab-442e-8739-2d5e28d6c0b1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:33.739033 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c0678344-48ab-442e-8739-2d5e28d6c0b1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1711 microversion: 2.1 time: 0.261361 Aug 24 12:35:33.739929 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 212/417] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:33 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1711 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:34.401076 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-8288797c-cbd4-42c9-91ad-194949c525ac req-2b955a86-0b64-40df-a359-aa49ebfb161a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab4d787-eab3-4654-8d9c-b7a7f10972ca", "tag": "0d661b8c-9ce8-4cb3-aeff-26f9ef9ed93e"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:34.411168 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-8288797c-cbd4-42c9-91ad-194949c525ac req-2b955a86-0b64-40df-a359-aa49ebfb161a service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:34.411675 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-8288797c-cbd4-42c9-91ad-194949c525ac req-2b955a86-0b64-40df-a359-aa49ebfb161a service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:34.412115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-8288797c-cbd4-42c9-91ad-194949c525ac req-2b955a86-0b64-40df-a359-aa49ebfb161a service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:34.426068 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-8288797c-cbd4-42c9-91ad-194949c525ac req-2b955a86-0b64-40df-a359-aa49ebfb161a service nova] Creating event network-changed:0d661b8c-9ce8-4cb3-aeff-26f9ef9ed93e for instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca on hv-cinder-84890 Aug 24 12:35:34.431032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-8288797c-cbd4-42c9-91ad-194949c525ac req-2b955a86-0b64-40df-a359-aa49ebfb161a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033513 Aug 24 12:35:34.431635 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 206/418] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:34.621519 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-cee20291-f098-4601-9685-211147f3633d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:34.622229 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-cee20291-f098-4601-9685-211147f3633d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:34.629790 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cee20291-f098-4601-9685-211147f3633d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:34.630279 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cee20291-f098-4601-9685-211147f3633d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:34.630923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cee20291-f098-4601-9685-211147f3633d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:34.631617 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cee20291-f098-4601-9685-211147f3633d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:34.632247 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cee20291-f098-4601-9685-211147f3633d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:34.633167 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cee20291-f098-4601-9685-211147f3633d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:34.768819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cee20291-f098-4601-9685-211147f3633d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:34.772287 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=100 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:34.778622 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cee20291-f098-4601-9685-211147f3633d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:34.780124 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cee20291-f098-4601-9685-211147f3633d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:34.781273 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-cee20291-f098-4601-9685-211147f3633d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.163812 Aug 24 12:35:34.781822 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 213/419] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:34 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:35.804784 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0fac0f38-eb4d-498b-a4cb-f080d3ba423d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:35.805484 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0fac0f38-eb4d-498b-a4cb-f080d3ba423d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:35.812514 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fac0f38-eb4d-498b-a4cb-f080d3ba423d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:35.813002 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fac0f38-eb4d-498b-a4cb-f080d3ba423d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:35.813450 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fac0f38-eb4d-498b-a4cb-f080d3ba423d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:35.814146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fac0f38-eb4d-498b-a4cb-f080d3ba423d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:35.814605 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fac0f38-eb4d-498b-a4cb-f080d3ba423d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:35.815032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fac0f38-eb4d-498b-a4cb-f080d3ba423d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:35.951324 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-0fac0f38-eb4d-498b-a4cb-f080d3ba423d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:35.960298 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-0fac0f38-eb4d-498b-a4cb-f080d3ba423d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:35.961794 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-0fac0f38-eb4d-498b-a4cb-f080d3ba423d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:35.962957 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0fac0f38-eb4d-498b-a4cb-f080d3ba423d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.162403 Aug 24 12:35:35.963515 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 207/420] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:35 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:36.987359 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-da0ed652-fd6a-44cf-8678-f784e0989719 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:36.987933 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-da0ed652-fd6a-44cf-8678-f784e0989719 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:36.994439 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da0ed652-fd6a-44cf-8678-f784e0989719 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:36.994921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da0ed652-fd6a-44cf-8678-f784e0989719 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:36.995356 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da0ed652-fd6a-44cf-8678-f784e0989719 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:36.996074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da0ed652-fd6a-44cf-8678-f784e0989719 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:36.996526 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da0ed652-fd6a-44cf-8678-f784e0989719 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:36.996946 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da0ed652-fd6a-44cf-8678-f784e0989719 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:37.121402 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-da0ed652-fd6a-44cf-8678-f784e0989719 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:37.134160 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-da0ed652-fd6a-44cf-8678-f784e0989719 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:37.135696 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-da0ed652-fd6a-44cf-8678-f784e0989719 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:37.137186 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-da0ed652-fd6a-44cf-8678-f784e0989719 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.153691 Aug 24 12:35:37.137753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 214/421] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:36 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:38.160806 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ca0357c8-9090-4cd7-b167-0776f2e3a6d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:38.161338 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ca0357c8-9090-4cd7-b167-0776f2e3a6d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:38.168231 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ca0357c8-9090-4cd7-b167-0776f2e3a6d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:38.168756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ca0357c8-9090-4cd7-b167-0776f2e3a6d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:38.169225 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ca0357c8-9090-4cd7-b167-0776f2e3a6d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:38.169917 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ca0357c8-9090-4cd7-b167-0776f2e3a6d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:38.170372 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ca0357c8-9090-4cd7-b167-0776f2e3a6d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:38.170800 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ca0357c8-9090-4cd7-b167-0776f2e3a6d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:38.297283 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ca0357c8-9090-4cd7-b167-0776f2e3a6d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:38.305774 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ca0357c8-9090-4cd7-b167-0776f2e3a6d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:38.307254 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ca0357c8-9090-4cd7-b167-0776f2e3a6d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:38.309161 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ca0357c8-9090-4cd7-b167-0776f2e3a6d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.151644 Aug 24 12:35:38.309874 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 208/422] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:38 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:39.332568 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-cf3d6861-be37-45ef-a75a-dd17b2b4f528 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:39.333184 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-cf3d6861-be37-45ef-a75a-dd17b2b4f528 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:39.339912 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cf3d6861-be37-45ef-a75a-dd17b2b4f528 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:39.340403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cf3d6861-be37-45ef-a75a-dd17b2b4f528 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:39.340839 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cf3d6861-be37-45ef-a75a-dd17b2b4f528 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:39.341528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cf3d6861-be37-45ef-a75a-dd17b2b4f528 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:39.341982 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cf3d6861-be37-45ef-a75a-dd17b2b4f528 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:39.342405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cf3d6861-be37-45ef-a75a-dd17b2b4f528 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:39.474320 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cf3d6861-be37-45ef-a75a-dd17b2b4f528 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:39.482719 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cf3d6861-be37-45ef-a75a-dd17b2b4f528 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:39.484233 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cf3d6861-be37-45ef-a75a-dd17b2b4f528 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:39.485371 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-cf3d6861-be37-45ef-a75a-dd17b2b4f528 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.156917 Aug 24 12:35:39.485925 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 215/423] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:39 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:40.508992 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3d1eff7f-780f-4b5c-a4d0-a167ded3e793 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:40.509763 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3d1eff7f-780f-4b5c-a4d0-a167ded3e793 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:40.516559 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3d1eff7f-780f-4b5c-a4d0-a167ded3e793 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:40.517063 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3d1eff7f-780f-4b5c-a4d0-a167ded3e793 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:40.517485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3d1eff7f-780f-4b5c-a4d0-a167ded3e793 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:40.518217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3d1eff7f-780f-4b5c-a4d0-a167ded3e793 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:40.518672 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3d1eff7f-780f-4b5c-a4d0-a167ded3e793 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:40.519101 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3d1eff7f-780f-4b5c-a4d0-a167ded3e793 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:40.587074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-ade86b6b-9822-49b7-96fd-db36948a4605 req-66d8ed3f-56fc-4be7-9a8f-4aff133ba4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09b5ebb-0578-465d-a6ad-03383fdeca05", "name": "network-vif-plugged", "status": "completed", "tag": "170ac04a-b7df-4c9d-939a-edc705e2589c"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:40.598665 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-ade86b6b-9822-49b7-96fd-db36948a4605 req-66d8ed3f-56fc-4be7-9a8f-4aff133ba4a8 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:40.599135 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-ade86b6b-9822-49b7-96fd-db36948a4605 req-66d8ed3f-56fc-4be7-9a8f-4aff133ba4a8 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:40.599553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-ade86b6b-9822-49b7-96fd-db36948a4605 req-66d8ed3f-56fc-4be7-9a8f-4aff133ba4a8 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:40.611983 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-ade86b6b-9822-49b7-96fd-db36948a4605 req-66d8ed3f-56fc-4be7-9a8f-4aff133ba4a8 service nova] Creating event network-vif-plugged:170ac04a-b7df-4c9d-939a-edc705e2589c for instance e09b5ebb-0578-465d-a6ad-03383fdeca05 on hv-cinder-84890 Aug 24 12:35:40.619500 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-ade86b6b-9822-49b7-96fd-db36948a4605 req-66d8ed3f-56fc-4be7-9a8f-4aff133ba4a8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036097 Aug 24 12:35:40.620740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 216/424] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:35:40.659610 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-3d1eff7f-780f-4b5c-a4d0-a167ded3e793 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:40.676228 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-3d1eff7f-780f-4b5c-a4d0-a167ded3e793 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:40.677719 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-3d1eff7f-780f-4b5c-a4d0-a167ded3e793 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:40.678859 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3d1eff7f-780f-4b5c-a4d0-a167ded3e793 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.174025 Aug 24 12:35:40.679413 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 209/425] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:40 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:41.706711 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-98082d89-463a-4a47-ad4b-211b8269efdf tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:41.707319 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-98082d89-463a-4a47-ad4b-211b8269efdf tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:41.713422 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-98082d89-463a-4a47-ad4b-211b8269efdf tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:41.713898 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-98082d89-463a-4a47-ad4b-211b8269efdf tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:41.714368 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-98082d89-463a-4a47-ad4b-211b8269efdf tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:41.715288 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-98082d89-463a-4a47-ad4b-211b8269efdf tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:41.715772 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-98082d89-463a-4a47-ad4b-211b8269efdf tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:41.716192 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-98082d89-463a-4a47-ad4b-211b8269efdf tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:41.847255 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-98082d89-463a-4a47-ad4b-211b8269efdf tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:41.856474 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-98082d89-463a-4a47-ad4b-211b8269efdf tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:41.857958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-98082d89-463a-4a47-ad4b-211b8269efdf tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:41.859104 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-98082d89-463a-4a47-ad4b-211b8269efdf tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.157468 Aug 24 12:35:41.859675 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 217/426] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:41 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:42.887502 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e10f5bf5-f3a6-46b1-b71b-7255f6ffc9f8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:42.888210 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e10f5bf5-f3a6-46b1-b71b-7255f6ffc9f8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:42.894309 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e10f5bf5-f3a6-46b1-b71b-7255f6ffc9f8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:42.894795 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e10f5bf5-f3a6-46b1-b71b-7255f6ffc9f8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:42.895146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e10f5bf5-f3a6-46b1-b71b-7255f6ffc9f8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:42.895864 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e10f5bf5-f3a6-46b1-b71b-7255f6ffc9f8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:42.896384 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e10f5bf5-f3a6-46b1-b71b-7255f6ffc9f8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:42.896750 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e10f5bf5-f3a6-46b1-b71b-7255f6ffc9f8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:43.028929 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e10f5bf5-f3a6-46b1-b71b-7255f6ffc9f8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:43.037657 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e10f5bf5-f3a6-46b1-b71b-7255f6ffc9f8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:43.039160 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e10f5bf5-f3a6-46b1-b71b-7255f6ffc9f8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:43.040349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e10f5bf5-f3a6-46b1-b71b-7255f6ffc9f8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1809 microversion: 2.20 time: 0.161973 Aug 24 12:35:43.040899 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 210/427] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:42 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:44.064530 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2c07dc79-1fbc-40a2-8bac-bae8ea88a2e2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:44.065109 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2c07dc79-1fbc-40a2-8bac-bae8ea88a2e2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:44.071502 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c07dc79-1fbc-40a2-8bac-bae8ea88a2e2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:44.072006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c07dc79-1fbc-40a2-8bac-bae8ea88a2e2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:44.072437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c07dc79-1fbc-40a2-8bac-bae8ea88a2e2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:44.073109 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c07dc79-1fbc-40a2-8bac-bae8ea88a2e2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:44.073553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c07dc79-1fbc-40a2-8bac-bae8ea88a2e2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:44.074579 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c07dc79-1fbc-40a2-8bac-bae8ea88a2e2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:44.203706 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2c07dc79-1fbc-40a2-8bac-bae8ea88a2e2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:44.212220 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2c07dc79-1fbc-40a2-8bac-bae8ea88a2e2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:44.213717 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2c07dc79-1fbc-40a2-8bac-bae8ea88a2e2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:44.214873 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2c07dc79-1fbc-40a2-8bac-bae8ea88a2e2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1796 microversion: 2.20 time: 0.154269 Aug 24 12:35:44.215421 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 218/428] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:44 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1796 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:51.659163 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-39587f78-0fbf-4284-8e58-6ef656e360e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "672e6b28-87a7-4ef0-bdaa-93802933fe21"}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:51.661517 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-39587f78-0fbf-4284-8e58-6ef656e360e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:51.664155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=52 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:51.669886 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39587f78-0fbf-4284-8e58-6ef656e360e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:51.670362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39587f78-0fbf-4284-8e58-6ef656e360e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:51.670799 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39587f78-0fbf-4284-8e58-6ef656e360e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:51.671482 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39587f78-0fbf-4284-8e58-6ef656e360e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:51.671977 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39587f78-0fbf-4284-8e58-6ef656e360e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:51.672395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39587f78-0fbf-4284-8e58-6ef656e360e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:51.924030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-39587f78-0fbf-4284-8e58-6ef656e360e9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "POST /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268464 Aug 24 12:35:51.924543 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 211/429] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 12:35:51 2022] POST /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:54.643660 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1c82da1d-c897-430c-86ec-7315f03f8886 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:54.644232 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1c82da1d-c897-430c-86ec-7315f03f8886 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:54.646775 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=19 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:54.647586 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=26 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:54.654543 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1c82da1d-c897-430c-86ec-7315f03f8886 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:54.655027 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1c82da1d-c897-430c-86ec-7315f03f8886 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:54.655464 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1c82da1d-c897-430c-86ec-7315f03f8886 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:54.656187 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1c82da1d-c897-430c-86ec-7315f03f8886 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:54.656651 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1c82da1d-c897-430c-86ec-7315f03f8886 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:54.657077 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1c82da1d-c897-430c-86ec-7315f03f8886 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:54.680833 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1c82da1d-c897-430c-86ec-7315f03f8886 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b/ips" status: 200 len: 148 microversion: 2.1 time: 0.040972 Aug 24 12:35:54.681402 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 219/430] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 12:35:54 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:54.695198 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0ca5f01b-fd3c-4955-8946-60a81e9189c0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b76cc74-757b-4ea4-b5d0-bb8852a5ba0d"}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:54.698559 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0ca5f01b-fd3c-4955-8946-60a81e9189c0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:54.705837 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0ca5f01b-fd3c-4955-8946-60a81e9189c0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:54.706706 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0ca5f01b-fd3c-4955-8946-60a81e9189c0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:54.707514 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0ca5f01b-fd3c-4955-8946-60a81e9189c0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:54.708655 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0ca5f01b-fd3c-4955-8946-60a81e9189c0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:54.709117 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0ca5f01b-fd3c-4955-8946-60a81e9189c0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:54.709550 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0ca5f01b-fd3c-4955-8946-60a81e9189c0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:54.794513 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-0ca5f01b-fd3c-4955-8946-60a81e9189c0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] HTTP exception thrown: Invalid volume: volume 6b76cc74-757b-4ea4-b5d0-bb8852a5ba0d is already attached to instances: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0ca5f01b-fd3c-4955-8946-60a81e9189c0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Request method failure captured: Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: POST /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b/os-volume_attachments HTTP/1.1 Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 74 Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhptX0YqROqNx9UwMblZH009WKCG7BL_aq4XeZf5ruCxnINLTbZjkM1uY9mAwjGHDX4uNPq1GuTB3ldLiiOiheC0oM9d1taj1Dr9v5q40AFD6MPcStG0igxeq4w-WcOLdJxPRTIIrqfH6xB1-wHZLVNdeJomT9Bmh01X6Epb9BGxpj8 Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:35:54.796272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:35:54.797847 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:35:54.797847 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:35:54.797847 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:35:54.797847 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:35:54.797847 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:35:54.797847 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:35:54.797847 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:35:54.797847 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 9aa753d1e2c4430498d5b28f0304952f Aug 24 12:35:54.797847 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:35:54.797847 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Aug 24 12:35:54.797847 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {"volumeAttachment": {"volumeId": "6b76cc74-757b-4ea4-b5d0-bb8852a5ba0d"}} Aug 24 12:35:54.797847 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Invalid volume: volume 6b76cc74-757b-4ea4-b5d0-bb8852a5ba0d is already attached to instances: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'server_id': '32a53b53-99f8-423a-b3f2-67416a5a323b', 'body': {'volumeAttachment': {'volumeId': '6b76cc74-757b-4ea4-b5d0-bb8852a5ba0d'}}} Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6b76cc74-757b-4ea4-b5d0-bb8852a5ba0d is already attached to instances: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:35:54.798742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6b76cc74-757b-4ea4-b5d0-bb8852a5ba0d is already attached to instances: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:35:54.800395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:35:54.801947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:35:54.801947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:35:54.801947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:35:54.801947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6b76cc74-757b-4ea4-b5d0-bb8852a5ba0d is already attached to instances: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda Aug 24 12:35:54.801947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:35:54.801947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0ca5f01b-fd3c-4955-8946-60a81e9189c0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Returning 400 to user: Invalid volume: volume 6b76cc74-757b-4ea4-b5d0-bb8852a5ba0d is already attached to instances: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:35:54.801947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0ca5f01b-fd3c-4955-8946-60a81e9189c0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "POST /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107364 Aug 24 12:35:54.801947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 212/431] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 12:35:54 2022] POST /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:35:54.806598 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-208b1ef8-e801-49a4-afeb-45933b7b638a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:54.807080 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-208b1ef8-e801-49a4-afeb-45933b7b638a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:54.814389 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-208b1ef8-e801-49a4-afeb-45933b7b638a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:54.814862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-208b1ef8-e801-49a4-afeb-45933b7b638a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:54.815288 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-208b1ef8-e801-49a4-afeb-45933b7b638a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:54.816012 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-208b1ef8-e801-49a4-afeb-45933b7b638a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:54.816454 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-208b1ef8-e801-49a4-afeb-45933b7b638a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:54.816868 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-208b1ef8-e801-49a4-afeb-45933b7b638a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:54.843116 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-208b1ef8-e801-49a4-afeb-45933b7b638a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Going to try to terminate instance {{(pid=127308) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:35:54.920892 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-208b1ef8-e801-49a4-afeb-45933b7b638a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "DELETE /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 204 len: 0 microversion: 2.1 time: 0.117685 Aug 24 12:35:54.921379 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 220/432] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:35:54 2022] DELETE /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:35:54.930849 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-27e20def-71e4-4137-bc5a-9a170ee0cb30 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:54.931469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-27e20def-71e4-4137-bc5a-9a170ee0cb30 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:54.939894 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-27e20def-71e4-4137-bc5a-9a170ee0cb30 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:54.940383 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-27e20def-71e4-4137-bc5a-9a170ee0cb30 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:54.940824 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-27e20def-71e4-4137-bc5a-9a170ee0cb30 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:54.941522 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-27e20def-71e4-4137-bc5a-9a170ee0cb30 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:54.941976 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-27e20def-71e4-4137-bc5a-9a170ee0cb30 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:54.942404 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-27e20def-71e4-4137-bc5a-9a170ee0cb30 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:55.077447 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-27e20def-71e4-4137-bc5a-9a170ee0cb30 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:55.083496 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-27e20def-71e4-4137-bc5a-9a170ee0cb30 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1679 microversion: 2.1 time: 0.157856 Aug 24 12:35:55.084080 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 213/433] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:54 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:56.105715 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-918a342e-b30d-44ad-aa90-41b1c52e73d4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:56.106427 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-918a342e-b30d-44ad-aa90-41b1c52e73d4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:56.112787 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-918a342e-b30d-44ad-aa90-41b1c52e73d4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:56.113269 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-918a342e-b30d-44ad-aa90-41b1c52e73d4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:56.113706 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-918a342e-b30d-44ad-aa90-41b1c52e73d4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:56.114400 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-918a342e-b30d-44ad-aa90-41b1c52e73d4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:56.114910 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-918a342e-b30d-44ad-aa90-41b1c52e73d4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:56.115334 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-918a342e-b30d-44ad-aa90-41b1c52e73d4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:56.248684 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-918a342e-b30d-44ad-aa90-41b1c52e73d4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:56.256236 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-918a342e-b30d-44ad-aa90-41b1c52e73d4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1679 microversion: 2.1 time: 0.155310 Aug 24 12:35:56.256792 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 221/434] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:56 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:57.278254 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-349d29a4-2bce-449a-b50f-f5f947db3ab5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:57.278859 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-349d29a4-2bce-449a-b50f-f5f947db3ab5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:57.285233 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-349d29a4-2bce-449a-b50f-f5f947db3ab5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:57.285717 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-349d29a4-2bce-449a-b50f-f5f947db3ab5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:57.286150 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-349d29a4-2bce-449a-b50f-f5f947db3ab5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:57.286849 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-349d29a4-2bce-449a-b50f-f5f947db3ab5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:57.287301 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-349d29a4-2bce-449a-b50f-f5f947db3ab5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:57.287747 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-349d29a4-2bce-449a-b50f-f5f947db3ab5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:57.290452 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:57.421437 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-349d29a4-2bce-449a-b50f-f5f947db3ab5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:57.429182 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-349d29a4-2bce-449a-b50f-f5f947db3ab5 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1679 microversion: 2.1 time: 0.155052 Aug 24 12:35:57.429734 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 214/435] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:57 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:57.876319 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-ee4681b3-cb16-47e1-8283-c0c3a1f0e606 req-0b51ad89-6e0b-4dd1-a503-a0dbf1cc8c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a53b53-99f8-423a-b3f2-67416a5a323b", "name": "network-vif-deleted", "tag": "cdff0ddd-8433-4eb5-8cd3-028ce16cd9b3"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:57.888505 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-ee4681b3-cb16-47e1-8283-c0c3a1f0e606 req-0b51ad89-6e0b-4dd1-a503-a0dbf1cc8c22 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:57.888979 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-ee4681b3-cb16-47e1-8283-c0c3a1f0e606 req-0b51ad89-6e0b-4dd1-a503-a0dbf1cc8c22 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:57.889399 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-ee4681b3-cb16-47e1-8283-c0c3a1f0e606 req-0b51ad89-6e0b-4dd1-a503-a0dbf1cc8c22 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:57.902234 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-ee4681b3-cb16-47e1-8283-c0c3a1f0e606 req-0b51ad89-6e0b-4dd1-a503-a0dbf1cc8c22 service nova] Creating event network-vif-deleted:cdff0ddd-8433-4eb5-8cd3-028ce16cd9b3 for instance 32a53b53-99f8-423a-b3f2-67416a5a323b on hv-cinder-84890 Aug 24 12:35:57.908012 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-ee4681b3-cb16-47e1-8283-c0c3a1f0e606 req-0b51ad89-6e0b-4dd1-a503-a0dbf1cc8c22 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035232 Aug 24 12:35:57.908871 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 222/436] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:35:58.451018 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d16aa888-f926-47df-ba6c-e29c8d30c8ce tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:58.451935 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d16aa888-f926-47df-ba6c-e29c8d30c8ce tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:58.458273 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d16aa888-f926-47df-ba6c-e29c8d30c8ce tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:58.458759 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d16aa888-f926-47df-ba6c-e29c8d30c8ce tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:58.459195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d16aa888-f926-47df-ba6c-e29c8d30c8ce tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:58.459996 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d16aa888-f926-47df-ba6c-e29c8d30c8ce tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:58.460446 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d16aa888-f926-47df-ba6c-e29c8d30c8ce tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:58.461082 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d16aa888-f926-47df-ba6c-e29c8d30c8ce tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:58.494242 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d16aa888-f926-47df-ba6c-e29c8d30c8ce tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:58.494724 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d16aa888-f926-47df-ba6c-e29c8d30c8ce tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:58.495193 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d16aa888-f926-47df-ba6c-e29c8d30c8ce tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:58.495669 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.objects.instance [None req-d16aa888-f926-47df-ba6c-e29c8d30c8ce tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lazy-loading 'fault' on Instance uuid 32a53b53-99f8-423a-b3f2-67416a5a323b {{(pid=127307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:35:58.544826 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-d16aa888-f926-47df-ba6c-e29c8d30c8ce tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:58.553720 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d16aa888-f926-47df-ba6c-e29c8d30c8ce tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 200 len: 1331 microversion: 2.1 time: 0.107192 Aug 24 12:35:58.554789 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 215/437] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:58 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:59.449242 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f4f82042-9763-4827-ba3e-f74176eb700c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:59.451766 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f4f82042-9763-4827-ba3e-f74176eb700c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:59.457799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f4f82042-9763-4827-ba3e-f74176eb700c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:59.458279 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f4f82042-9763-4827-ba3e-f74176eb700c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:59.458712 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f4f82042-9763-4827-ba3e-f74176eb700c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:59.459392 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f4f82042-9763-4827-ba3e-f74176eb700c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:59.459864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f4f82042-9763-4827-ba3e-f74176eb700c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:59.460286 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f4f82042-9763-4827-ba3e-f74176eb700c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:59.483306 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-f4f82042-9763-4827-ba3e-f74176eb700c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lazy-loading 'flavor' on Instance uuid 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:35:59.574891 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6d1df8d6-8f38-43b1-90ee-3323d8227728 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:59.576264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-6d1df8d6-8f38-43b1-90ee-3323d8227728 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:59.582932 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6d1df8d6-8f38-43b1-90ee-3323d8227728 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:59.583421 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6d1df8d6-8f38-43b1-90ee-3323d8227728 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:59.583890 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6d1df8d6-8f38-43b1-90ee-3323d8227728 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:59.584586 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6d1df8d6-8f38-43b1-90ee-3323d8227728 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:59.585042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6d1df8d6-8f38-43b1-90ee-3323d8227728 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:59.585470 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6d1df8d6-8f38-43b1-90ee-3323d8227728 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:59.599089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-6d1df8d6-8f38-43b1-90ee-3323d8227728 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] HTTP exception thrown: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6d1df8d6-8f38-43b1-90ee-3323d8227728 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Request method failure captured: Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b HTTP/1.1 Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhptX0YqROqNx9UwMblZH009WKCG7BL_aq4XeZf5ruCxnINLTbZjkM1uY9mAwjGHDX4uNPq1GuTB3ldLiiOiheC0oM9d1taj1Dr9v5q40AFD6MPcStG0igxeq4w-WcOLdJxPRTIIrqfH6xB1-wHZLVNdeJomT9Bmh01X6Epb9BGxpj8 Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:35:59.600654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:35:59.602235 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:35:59.602235 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:35:59.602235 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:35:59.602235 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:35:59.602235 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:35:59.602235 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:35:59.602235 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:35:59.602235 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 9aa753d1e2c4430498d5b28f0304952f Aug 24 12:35:59.602235 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:35:59.602235 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:35:59.602235 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. Aug 24 12:35:59.602235 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': '32a53b53-99f8-423a-b3f2-67416a5a323b'} Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:35:59.603202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. Aug 24 12:35:59.604851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:35:59.606374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6d1df8d6-8f38-43b1-90ee-3323d8227728 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Returning 404 to user: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:35:59.606374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-6d1df8d6-8f38-43b1-90ee-3323d8227728 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 404 len: 111 microversion: 2.1 time: 0.031644 Aug 24 12:35:59.606374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 216/438] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:59 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 12:35:59.610643 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f4f82042-9763-4827-ba3e-f74176eb700c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "POST /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/action" status: 200 len: 32 microversion: 2.1 time: 0.166757 Aug 24 12:35:59.615566 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 223/439] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 12:35:59 2022] POST /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:35:59.615738 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5a312138-a719-4e3f-806f-1e1f705b779b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '.version_select at 0x7f469dea0940>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:59.621445 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-39280a35-4955-49d1-9bf0-0bcb945dc635 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:59.622142 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-39280a35-4955-49d1-9bf0-0bcb945dc635 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:59.628381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-39280a35-4955-49d1-9bf0-0bcb945dc635 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:59.628867 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-39280a35-4955-49d1-9bf0-0bcb945dc635 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:59.629305 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-39280a35-4955-49d1-9bf0-0bcb945dc635 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:59.630004 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-39280a35-4955-49d1-9bf0-0bcb945dc635 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:59.630454 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-39280a35-4955-49d1-9bf0-0bcb945dc635 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:59.630878 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-39280a35-4955-49d1-9bf0-0bcb945dc635 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:59.632195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5a312138-a719-4e3f-806f-1e1f705b779b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-665338024" status: 202 len: 0 microversion: 2.1 time: 0.024364 Aug 24 12:35:59.632863 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 217/440] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 12:35:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-665338024 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:35:59.835568 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-39280a35-4955-49d1-9bf0-0bcb945dc635 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:59.846318 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-39280a35-4955-49d1-9bf0-0bcb945dc635 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.229323 Aug 24 12:35:59.847277 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 224/441] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:59 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:00.434460 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-58ff3f39-31f2-4d68-a43f-6711e34b684f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:00.434958 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-58ff3f39-31f2-4d68-a43f-6711e34b684f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:00.441602 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58ff3f39-31f2-4d68-a43f-6711e34b684f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:00.442087 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58ff3f39-31f2-4d68-a43f-6711e34b684f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:00.442556 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58ff3f39-31f2-4d68-a43f-6711e34b684f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:00.443250 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58ff3f39-31f2-4d68-a43f-6711e34b684f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:00.443737 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58ff3f39-31f2-4d68-a43f-6711e34b684f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:00.444175 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58ff3f39-31f2-4d68-a43f-6711e34b684f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:00.571823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.objects.instance [None req-58ff3f39-31f2-4d68-a43f-6711e34b684f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lazy-loading 'services' on Instance uuid 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda {{(pid=127307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:36:00.686125 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-58ff3f39-31f2-4d68-a43f-6711e34b684f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda/os-volume_attachments/6b76cc74-757b-4ea4-b5d0-bb8852a5ba0d" status: 202 len: 0 microversion: 2.1 time: 0.255656 Aug 24 12:36:00.686764 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 218/442] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 12:36:00 2022] DELETE /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda/os-volume_attachments/6b76cc74-757b-4ea4-b5d0-bb8852a5ba0d => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:36:00.696506 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-3d12a5ee-1ed4-492b-ba9f-1d2c29b70d8b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:00.699805 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-3d12a5ee-1ed4-492b-ba9f-1d2c29b70d8b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:00.708068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3d12a5ee-1ed4-492b-ba9f-1d2c29b70d8b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:00.708556 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3d12a5ee-1ed4-492b-ba9f-1d2c29b70d8b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:00.709503 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3d12a5ee-1ed4-492b-ba9f-1d2c29b70d8b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:00.710309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3d12a5ee-1ed4-492b-ba9f-1d2c29b70d8b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:00.710773 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3d12a5ee-1ed4-492b-ba9f-1d2c29b70d8b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:00.711193 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3d12a5ee-1ed4-492b-ba9f-1d2c29b70d8b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:00.741775 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-3d12a5ee-1ed4-492b-ba9f-1d2c29b70d8b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050310 Aug 24 12:36:00.742287 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 225/443] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:36:00 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:00.867673 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-475c1c0d-4a68-4362-95d9-9d67ca852f15 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:00.868374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-475c1c0d-4a68-4362-95d9-9d67ca852f15 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:00.874732 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-475c1c0d-4a68-4362-95d9-9d67ca852f15 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:00.875246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-475c1c0d-4a68-4362-95d9-9d67ca852f15 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:00.875701 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-475c1c0d-4a68-4362-95d9-9d67ca852f15 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:00.876418 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-475c1c0d-4a68-4362-95d9-9d67ca852f15 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:00.876868 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-475c1c0d-4a68-4362-95d9-9d67ca852f15 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:00.877287 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-475c1c0d-4a68-4362-95d9-9d67ca852f15 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:01.008682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-475c1c0d-4a68-4362-95d9-9d67ca852f15 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:01.017569 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-475c1c0d-4a68-4362-95d9-9d67ca852f15 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.154098 Aug 24 12:36:01.018138 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 219/444] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:00 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:01.754536 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-be660fd4-3af8-4206-b99a-fd961d6e3408 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:01.756642 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-be660fd4-3af8-4206-b99a-fd961d6e3408 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:01.763016 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be660fd4-3af8-4206-b99a-fd961d6e3408 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:01.763499 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be660fd4-3af8-4206-b99a-fd961d6e3408 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:01.763972 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be660fd4-3af8-4206-b99a-fd961d6e3408 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:01.764657 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be660fd4-3af8-4206-b99a-fd961d6e3408 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:01.765108 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be660fd4-3af8-4206-b99a-fd961d6e3408 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:01.765532 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be660fd4-3af8-4206-b99a-fd961d6e3408 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:01.794395 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-be660fd4-3af8-4206-b99a-fd961d6e3408 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043917 Aug 24 12:36:01.794937 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 226/445] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:36:01 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:36:01.856142 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3ce3242d-51d4-4c38-9ebf-1d5f2173b37e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:01.856648 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3ce3242d-51d4-4c38-9ebf-1d5f2173b37e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:01.863602 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ce3242d-51d4-4c38-9ebf-1d5f2173b37e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:01.863826 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ce3242d-51d4-4c38-9ebf-1d5f2173b37e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:01.864194 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ce3242d-51d4-4c38-9ebf-1d5f2173b37e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:01.864893 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ce3242d-51d4-4c38-9ebf-1d5f2173b37e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:01.865348 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ce3242d-51d4-4c38-9ebf-1d5f2173b37e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:01.865777 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ce3242d-51d4-4c38-9ebf-1d5f2173b37e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:01.891010 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3ce3242d-51d4-4c38-9ebf-1d5f2173b37e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Going to try to terminate instance {{(pid=127307) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:36:01.974581 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3ce3242d-51d4-4c38-9ebf-1d5f2173b37e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 204 len: 0 microversion: 2.1 time: 0.122760 Aug 24 12:36:01.975200 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 220/446] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:36:01 2022] DELETE /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:36:01.984117 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4716bd49-6834-4a01-89dd-d38b3c00fe5d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:01.984755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4716bd49-6834-4a01-89dd-d38b3c00fe5d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:01.990598 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4716bd49-6834-4a01-89dd-d38b3c00fe5d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:01.991082 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4716bd49-6834-4a01-89dd-d38b3c00fe5d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:01.991515 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4716bd49-6834-4a01-89dd-d38b3c00fe5d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:01.992234 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4716bd49-6834-4a01-89dd-d38b3c00fe5d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:01.992687 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4716bd49-6834-4a01-89dd-d38b3c00fe5d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:01.993106 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4716bd49-6834-4a01-89dd-d38b3c00fe5d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:02.039350 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-7ef51e0d-1d42-482c-bf7b-890169fe3951 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:02.039997 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-7ef51e0d-1d42-482c-bf7b-890169fe3951 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:02.046871 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7ef51e0d-1d42-482c-bf7b-890169fe3951 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:02.047363 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7ef51e0d-1d42-482c-bf7b-890169fe3951 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:02.047835 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7ef51e0d-1d42-482c-bf7b-890169fe3951 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:02.048529 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7ef51e0d-1d42-482c-bf7b-890169fe3951 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:02.048983 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7ef51e0d-1d42-482c-bf7b-890169fe3951 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:02.049404 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7ef51e0d-1d42-482c-bf7b-890169fe3951 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:02.165220 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4716bd49-6834-4a01-89dd-d38b3c00fe5d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:02.173223 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4716bd49-6834-4a01-89dd-d38b3c00fe5d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1678 microversion: 2.1 time: 0.193651 Aug 24 12:36:02.173799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 227/447] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:01 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1678 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:02.209040 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7ef51e0d-1d42-482c-bf7b-890169fe3951 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:02.217920 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-7ef51e0d-1d42-482c-bf7b-890169fe3951 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.182839 Aug 24 12:36:02.218490 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 221/448] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:02 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:03.194423 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-0b8208e2-059b-4d38-aaa3-3558d2e9e59d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:03.195077 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-0b8208e2-059b-4d38-aaa3-3558d2e9e59d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:03.201396 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0b8208e2-059b-4d38-aaa3-3558d2e9e59d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:03.202144 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0b8208e2-059b-4d38-aaa3-3558d2e9e59d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:03.202575 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0b8208e2-059b-4d38-aaa3-3558d2e9e59d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:03.203274 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0b8208e2-059b-4d38-aaa3-3558d2e9e59d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:03.203735 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0b8208e2-059b-4d38-aaa3-3558d2e9e59d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:03.204155 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0b8208e2-059b-4d38-aaa3-3558d2e9e59d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:03.238604 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-08fb619e-55d3-45ef-aaa2-2b8b8eae5844 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:03.239247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-08fb619e-55d3-45ef-aaa2-2b8b8eae5844 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:03.245928 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-08fb619e-55d3-45ef-aaa2-2b8b8eae5844 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:03.246418 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-08fb619e-55d3-45ef-aaa2-2b8b8eae5844 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:03.246862 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-08fb619e-55d3-45ef-aaa2-2b8b8eae5844 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:03.247570 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-08fb619e-55d3-45ef-aaa2-2b8b8eae5844 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:03.248055 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-08fb619e-55d3-45ef-aaa2-2b8b8eae5844 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:03.248482 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-08fb619e-55d3-45ef-aaa2-2b8b8eae5844 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:03.392533 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-0b8208e2-059b-4d38-aaa3-3558d2e9e59d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:03.400190 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-0b8208e2-059b-4d38-aaa3-3558d2e9e59d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1678 microversion: 2.1 time: 0.209678 Aug 24 12:36:03.400753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 228/449] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:03 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:03.415254 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-08fb619e-55d3-45ef-aaa2-2b8b8eae5844 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:03.423569 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-08fb619e-55d3-45ef-aaa2-2b8b8eae5844 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.188759 Aug 24 12:36:03.424155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 222/450] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:03 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:04.422226 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7e68cf41-0fee-4b21-b7ce-b712ca7082f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:04.422782 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-7e68cf41-0fee-4b21-b7ce-b712ca7082f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:04.429311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e68cf41-0fee-4b21-b7ce-b712ca7082f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:04.429795 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e68cf41-0fee-4b21-b7ce-b712ca7082f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:04.430442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e68cf41-0fee-4b21-b7ce-b712ca7082f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:04.431143 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e68cf41-0fee-4b21-b7ce-b712ca7082f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:04.431595 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e68cf41-0fee-4b21-b7ce-b712ca7082f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:04.432047 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e68cf41-0fee-4b21-b7ce-b712ca7082f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:04.445658 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-03824dc3-0430-4922-b6e1-83e9ab68c992 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:04.446274 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-03824dc3-0430-4922-b6e1-83e9ab68c992 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:04.453270 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-03824dc3-0430-4922-b6e1-83e9ab68c992 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:04.453853 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-03824dc3-0430-4922-b6e1-83e9ab68c992 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:04.454360 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-03824dc3-0430-4922-b6e1-83e9ab68c992 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:04.455522 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-03824dc3-0430-4922-b6e1-83e9ab68c992 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:04.456207 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-03824dc3-0430-4922-b6e1-83e9ab68c992 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:04.456997 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-03824dc3-0430-4922-b6e1-83e9ab68c992 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:04.640132 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-7e68cf41-0fee-4b21-b7ce-b712ca7082f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:04.646668 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-03824dc3-0430-4922-b6e1-83e9ab68c992 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:04.655073 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-7e68cf41-0fee-4b21-b7ce-b712ca7082f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 200 len: 1678 microversion: 2.1 time: 0.236738 Aug 24 12:36:04.656051 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 229/451] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:04 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:04.656297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-03824dc3-0430-4922-b6e1-83e9ab68c992 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.214850 Aug 24 12:36:04.656860 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 223/452] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:04 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:05.123141 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-5d7cef88-0e5b-476b-be27-90eafabcbf7b req-d6726d1e-c7eb-49ee-b650-727f28264174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5f3300-5ec6-4d3e-b94b-23041ffe7bda", "name": "network-vif-deleted", "tag": "3830e132-a365-42e2-bb6e-5e8a8b16e891"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:05.132883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-5d7cef88-0e5b-476b-be27-90eafabcbf7b req-d6726d1e-c7eb-49ee-b650-727f28264174 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:05.133611 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-5d7cef88-0e5b-476b-be27-90eafabcbf7b req-d6726d1e-c7eb-49ee-b650-727f28264174 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:05.134036 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-5d7cef88-0e5b-476b-be27-90eafabcbf7b req-d6726d1e-c7eb-49ee-b650-727f28264174 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:05.146132 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-5d7cef88-0e5b-476b-be27-90eafabcbf7b req-d6726d1e-c7eb-49ee-b650-727f28264174 service nova] Creating event network-vif-deleted:3830e132-a365-42e2-bb6e-5e8a8b16e891 for instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda on hv-cinder-84890 Aug 24 12:36:05.151212 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-5d7cef88-0e5b-476b-be27-90eafabcbf7b req-d6726d1e-c7eb-49ee-b650-727f28264174 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032500 Aug 24 12:36:05.151860 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 230/453] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:05.676770 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2655cac5-5722-43ee-835e-4459b3b05a3c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:05.678280 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2655cac5-5722-43ee-835e-4459b3b05a3c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:05.681366 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-85c9d071-1291-427a-9d44-14000298cd6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:05.682258 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-85c9d071-1291-427a-9d44-14000298cd6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:05.687358 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2655cac5-5722-43ee-835e-4459b3b05a3c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:05.688107 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2655cac5-5722-43ee-835e-4459b3b05a3c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:05.688740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2655cac5-5722-43ee-835e-4459b3b05a3c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:05.689499 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2655cac5-5722-43ee-835e-4459b3b05a3c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:05.690342 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2655cac5-5722-43ee-835e-4459b3b05a3c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:05.690931 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2655cac5-5722-43ee-835e-4459b3b05a3c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:05.693532 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85c9d071-1291-427a-9d44-14000298cd6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:05.694236 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85c9d071-1291-427a-9d44-14000298cd6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:05.694767 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85c9d071-1291-427a-9d44-14000298cd6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:05.695840 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85c9d071-1291-427a-9d44-14000298cd6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:05.696424 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85c9d071-1291-427a-9d44-14000298cd6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:05.696950 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-85c9d071-1291-427a-9d44-14000298cd6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:05.713169 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-85c9d071-1291-427a-9d44-14000298cd6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] HTTP exception thrown: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-85c9d071-1291-427a-9d44-14000298cd6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Request method failure captured: Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda HTTP/1.1 Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhptX0YqROqNx9UwMblZH009WKCG7BL_aq4XeZf5ruCxnINLTbZjkM1uY9mAwjGHDX4uNPq1GuTB3ldLiiOiheC0oM9d1taj1Dr9v5q40AFD6MPcStG0igxeq4w-WcOLdJxPRTIIrqfH6xB1-wHZLVNdeJomT9Bmh01X6Epb9BGxpj8 Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:36:05.715388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:36:05.717006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:36:05.717006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:36:05.717006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:36:05.717006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:36:05.717006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:36:05.717006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:36:05.717006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:36:05.717006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 9aa753d1e2c4430498d5b28f0304952f Aug 24 12:36:05.717006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:36:05.717006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:36:05.717006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. Aug 24 12:36:05.717006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '3b5f3300-5ec6-4d3e-b94b-23041ffe7bda'} Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:36:05.717883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. Aug 24 12:36:05.719088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:36:05.720190 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-85c9d071-1291-427a-9d44-14000298cd6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Returning 404 to user: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:36:05.720190 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-85c9d071-1291-427a-9d44-14000298cd6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 404 len: 111 microversion: 2.1 time: 0.043820 Aug 24 12:36:05.720190 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 231/454] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:05 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:36:05.728122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1516e3bf-1272-488f-81e8-9851dc8aa7b9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '.version_select at 0x7f4696cce4c0>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:05.749603 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1516e3bf-1272-488f-81e8-9851dc8aa7b9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-87239204" status: 202 len: 0 microversion: 2.1 time: 0.025450 Aug 24 12:36:05.750575 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 232/455] 10.222.0.58 () {58 vars in 1215 bytes} [Wed Aug 24 12:36:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-87239204 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:36:05.871880 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2655cac5-5722-43ee-835e-4459b3b05a3c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:05.888352 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2655cac5-5722-43ee-835e-4459b3b05a3c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.215523 Aug 24 12:36:05.889554 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 224/456] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:05 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:06.418811 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d90d862e-0806-421d-891d-72742ce0db36 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Action: 'create', calling method: .version_select at 0x7f4696cb19d0>, body: {"keypair": {"name": "tempest-keypair-1903419479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyqy4G0jhxJP547R+MEUb9M1IX5dQ+hSQhQzcgd83wTsR4VBgo2rnEzUj68RQk4ZBo4cOmbuFQhM1Wy6WQ2zq7zx+Och5pFH/1yVfWV+bSs3BcvUCog+yzypwXPU/kYlg=="}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:06.435350 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-d90d862e-0806-421d-891d-72742ce0db36 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for project f3a2fec602684ab1a454b8da589b4787. Resources: {'key_pairs'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:36:06.439067 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-d90d862e-0806-421d-891d-72742ce0db36 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for user 9aa753d1e2c4430498d5b28f0304952f and project f3a2fec602684ab1a454b8da589b4787. Resources: {'key_pairs'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:36:06.462430 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d90d862e-0806-421d-891d-72742ce0db36 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047597 Aug 24 12:36:06.463008 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 233/457] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 12:36:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:06.909638 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5cc8f523-bd12-4337-a706-fb42d1ec0d9c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:06.910251 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5cc8f523-bd12-4337-a706-fb42d1ec0d9c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:06.916638 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5cc8f523-bd12-4337-a706-fb42d1ec0d9c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:06.917127 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5cc8f523-bd12-4337-a706-fb42d1ec0d9c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:06.917566 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5cc8f523-bd12-4337-a706-fb42d1ec0d9c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:06.918267 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5cc8f523-bd12-4337-a706-fb42d1ec0d9c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:06.918725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5cc8f523-bd12-4337-a706-fb42d1ec0d9c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:06.919154 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5cc8f523-bd12-4337-a706-fb42d1ec0d9c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:07.048260 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5cc8f523-bd12-4337-a706-fb42d1ec0d9c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:07.056435 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5cc8f523-bd12-4337-a706-fb42d1ec0d9c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.150733 Aug 24 12:36:07.057076 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 225/458] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:06 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:07.713684 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-154783941", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6afd549-e037-4fe8-8751-48a00c7127d1"}], "security_groups": [{"name": "tempest-securitygroup--1249937367"}], "key_name": "tempest-keypair-1903419479", "user_data": "}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:07.818314 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.network.neutron [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] validate_networks() for [('a6afd549-e037-4fe8-8751-48a00c7127d1', None, None, None, None, None)] {{(pid=127308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:36:08.077497 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-58cbe4b7-69a0-426b-8a6d-d3156adf5805 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:08.078242 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-58cbe4b7-69a0-426b-8a6d-d3156adf5805 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:08.084341 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58cbe4b7-69a0-426b-8a6d-d3156adf5805 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:08.084814 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58cbe4b7-69a0-426b-8a6d-d3156adf5805 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:08.085252 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58cbe4b7-69a0-426b-8a6d-d3156adf5805 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:08.085946 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58cbe4b7-69a0-426b-8a6d-d3156adf5805 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:08.086401 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58cbe4b7-69a0-426b-8a6d-d3156adf5805 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:08.086831 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58cbe4b7-69a0-426b-8a6d-d3156adf5805 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:08.245878 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Flavor limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:36:08.246226 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Image limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:36:08.246688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Flavor pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:36:08.247086 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Image pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:36:08.247520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:36:08.256382 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:08.256856 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:08.257281 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:08.257990 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:08.258438 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:08.258857 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:08.273832 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-58cbe4b7-69a0-426b-8a6d-d3156adf5805 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:08.276947 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for project f3a2fec602684ab1a454b8da589b4787. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:36:08.280866 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for user 9aa753d1e2c4430498d5b28f0304952f and project f3a2fec602684ab1a454b8da589b4787. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:36:08.282398 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-58cbe4b7-69a0-426b-8a6d-d3156adf5805 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.209069 Aug 24 12:36:08.282971 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 226/459] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:08 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:08.291565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Going to run 1 instances... {{(pid=127308) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:36:08.294503 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:36:08.341135 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-3bff92c6-0d15-4f66-99ea-49c9ac3ee5e0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.631894 Aug 24 12:36:08.341770 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 234/460] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:36:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:36:08.352538 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8d4eb200-1728-4c0d-97b9-bf8537f66935 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:08.353188 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8d4eb200-1728-4c0d-97b9-bf8537f66935 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:08.411343 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8d4eb200-1728-4c0d-97b9-bf8537f66935 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:08.418824 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8d4eb200-1728-4c0d-97b9-bf8537f66935 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 200 len: 1241 microversion: 2.1 time: 0.070151 Aug 24 12:36:08.419388 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 227/461] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:08 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:09.303985 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-3c22e30d-65b7-40f8-8168-ddd6fd41af0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:09.304723 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-3c22e30d-65b7-40f8-8168-ddd6fd41af0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:09.312550 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3c22e30d-65b7-40f8-8168-ddd6fd41af0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:09.313030 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3c22e30d-65b7-40f8-8168-ddd6fd41af0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:09.313450 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3c22e30d-65b7-40f8-8168-ddd6fd41af0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:09.314392 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3c22e30d-65b7-40f8-8168-ddd6fd41af0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:09.315026 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3c22e30d-65b7-40f8-8168-ddd6fd41af0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:09.315605 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3c22e30d-65b7-40f8-8168-ddd6fd41af0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:09.442760 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2959f9ea-37f8-48a1-a52e-0bd93f54498d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:09.443691 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2959f9ea-37f8-48a1-a52e-0bd93f54498d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:09.455540 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2959f9ea-37f8-48a1-a52e-0bd93f54498d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:09.456074 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2959f9ea-37f8-48a1-a52e-0bd93f54498d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:09.456519 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2959f9ea-37f8-48a1-a52e-0bd93f54498d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:09.457234 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2959f9ea-37f8-48a1-a52e-0bd93f54498d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:09.457691 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2959f9ea-37f8-48a1-a52e-0bd93f54498d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:09.458120 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2959f9ea-37f8-48a1-a52e-0bd93f54498d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:09.465904 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-3c22e30d-65b7-40f8-8168-ddd6fd41af0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:09.474505 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-3c22e30d-65b7-40f8-8168-ddd6fd41af0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.174842 Aug 24 12:36:09.475070 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 235/462] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:09 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:09.525692 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2959f9ea-37f8-48a1-a52e-0bd93f54498d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:09.534636 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2959f9ea-37f8-48a1-a52e-0bd93f54498d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 200 len: 1299 microversion: 2.1 time: 0.095517 Aug 24 12:36:09.535208 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 228/463] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:09 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:10.496938 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ab217ec9-b56f-4aab-bd9a-eab79e605b74 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:10.497568 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-ab217ec9-b56f-4aab-bd9a-eab79e605b74 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:10.503958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ab217ec9-b56f-4aab-bd9a-eab79e605b74 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:10.504437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ab217ec9-b56f-4aab-bd9a-eab79e605b74 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:10.504867 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ab217ec9-b56f-4aab-bd9a-eab79e605b74 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:10.505550 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ab217ec9-b56f-4aab-bd9a-eab79e605b74 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:10.506002 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ab217ec9-b56f-4aab-bd9a-eab79e605b74 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:10.506424 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ab217ec9-b56f-4aab-bd9a-eab79e605b74 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:10.558130 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-74e40844-1b90-4579-88e5-bd11a1b5b706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:10.558931 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-74e40844-1b90-4579-88e5-bd11a1b5b706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:10.565649 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74e40844-1b90-4579-88e5-bd11a1b5b706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:10.566259 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74e40844-1b90-4579-88e5-bd11a1b5b706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:10.566760 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74e40844-1b90-4579-88e5-bd11a1b5b706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:10.567528 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74e40844-1b90-4579-88e5-bd11a1b5b706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:10.568077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74e40844-1b90-4579-88e5-bd11a1b5b706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:10.568599 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74e40844-1b90-4579-88e5-bd11a1b5b706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:10.708371 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ab217ec9-b56f-4aab-bd9a-eab79e605b74 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:10.715038 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:10.724865 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-ab217ec9-b56f-4aab-bd9a-eab79e605b74 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.232431 Aug 24 12:36:10.726141 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 236/464] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:10 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:10.731962 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-7c670895-b43f-4a05-b2dc-9303bcfc635e req-90ec0ea5-1e8b-41bd-9d0b-2f7455fa8f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871692ae-90bf-465a-ba88-24cfd077e5de", "tag": "7e0ebfc0-7898-40d1-8443-1a6da286d30e"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:10.738353 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-74e40844-1b90-4579-88e5-bd11a1b5b706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:10.752408 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-74e40844-1b90-4579-88e5-bd11a1b5b706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 200 len: 1367 microversion: 2.1 time: 0.198606 Aug 24 12:36:10.753148 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 229/465] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:10 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:10.762066 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-7c670895-b43f-4a05-b2dc-9303bcfc635e req-90ec0ea5-1e8b-41bd-9d0b-2f7455fa8f88 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:10.762675 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-7c670895-b43f-4a05-b2dc-9303bcfc635e req-90ec0ea5-1e8b-41bd-9d0b-2f7455fa8f88 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:10.763229 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-7c670895-b43f-4a05-b2dc-9303bcfc635e req-90ec0ea5-1e8b-41bd-9d0b-2f7455fa8f88 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:10.779253 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-7c670895-b43f-4a05-b2dc-9303bcfc635e req-90ec0ea5-1e8b-41bd-9d0b-2f7455fa8f88 service nova] Creating event network-changed:7e0ebfc0-7898-40d1-8443-1a6da286d30e for instance 871692ae-90bf-465a-ba88-24cfd077e5de on hv-cinder-84890 Aug 24 12:36:10.784572 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-7c670895-b43f-4a05-b2dc-9303bcfc635e req-90ec0ea5-1e8b-41bd-9d0b-2f7455fa8f88 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057014 Aug 24 12:36:10.785184 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 237/466] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:11.746088 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-4db5b19a-c1fe-4de3-bb96-5d3682b9acca tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:11.746608 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-4db5b19a-c1fe-4de3-bb96-5d3682b9acca tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:11.753030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4db5b19a-c1fe-4de3-bb96-5d3682b9acca tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:11.753519 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4db5b19a-c1fe-4de3-bb96-5d3682b9acca tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:11.753957 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4db5b19a-c1fe-4de3-bb96-5d3682b9acca tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:11.754655 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4db5b19a-c1fe-4de3-bb96-5d3682b9acca tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:11.755112 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4db5b19a-c1fe-4de3-bb96-5d3682b9acca tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:11.755542 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4db5b19a-c1fe-4de3-bb96-5d3682b9acca tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:11.774045 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e02eba63-6d09-47a1-898e-cba1c337ae35 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:11.774771 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e02eba63-6d09-47a1-898e-cba1c337ae35 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:11.781513 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e02eba63-6d09-47a1-898e-cba1c337ae35 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:11.781997 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e02eba63-6d09-47a1-898e-cba1c337ae35 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:11.782431 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e02eba63-6d09-47a1-898e-cba1c337ae35 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:11.783153 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e02eba63-6d09-47a1-898e-cba1c337ae35 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:11.783605 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e02eba63-6d09-47a1-898e-cba1c337ae35 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:11.784061 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e02eba63-6d09-47a1-898e-cba1c337ae35 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:11.960918 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-4db5b19a-c1fe-4de3-bb96-5d3682b9acca tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:11.963201 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:11.968863 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e02eba63-6d09-47a1-898e-cba1c337ae35 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:11.971431 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-4db5b19a-c1fe-4de3-bb96-5d3682b9acca tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.229209 Aug 24 12:36:11.972041 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 230/467] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:11 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:11.976472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e02eba63-6d09-47a1-898e-cba1c337ae35 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 200 len: 1367 microversion: 2.1 time: 0.207001 Aug 24 12:36:11.977026 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 238/468] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:11 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:12.992242 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9aa283ce-ac24-4279-86ae-f7cfa80e6f81 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:12.992966 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-9aa283ce-ac24-4279-86ae-f7cfa80e6f81 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:12.996737 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-3bb55154-32f8-49bb-ab2a-a187362e97ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:12.997315 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-3bb55154-32f8-49bb-ab2a-a187362e97ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:13.001187 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9aa283ce-ac24-4279-86ae-f7cfa80e6f81 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:13.001670 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9aa283ce-ac24-4279-86ae-f7cfa80e6f81 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:13.002099 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9aa283ce-ac24-4279-86ae-f7cfa80e6f81 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:13.002790 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9aa283ce-ac24-4279-86ae-f7cfa80e6f81 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:13.003265 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9aa283ce-ac24-4279-86ae-f7cfa80e6f81 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:13.003708 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9aa283ce-ac24-4279-86ae-f7cfa80e6f81 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:13.003819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bb55154-32f8-49bb-ab2a-a187362e97ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:13.004197 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bb55154-32f8-49bb-ab2a-a187362e97ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:13.004628 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bb55154-32f8-49bb-ab2a-a187362e97ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:13.005315 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bb55154-32f8-49bb-ab2a-a187362e97ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:13.005765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bb55154-32f8-49bb-ab2a-a187362e97ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:13.006189 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3bb55154-32f8-49bb-ab2a-a187362e97ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:13.203493 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-9aa283ce-ac24-4279-86ae-f7cfa80e6f81 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:13.207490 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-3bb55154-32f8-49bb-ab2a-a187362e97ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:13.211583 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9aa283ce-ac24-4279-86ae-f7cfa80e6f81 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.223127 Aug 24 12:36:13.212178 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 231/469] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:12 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:13.215796 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-3bb55154-32f8-49bb-ab2a-a187362e97ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 200 len: 1367 microversion: 2.1 time: 0.222865 Aug 24 12:36:13.216355 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 239/470] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:12 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:14.234324 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ab78c5b8-9c49-4fd2-bc40-b228a86b2754 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:14.235065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ab78c5b8-9c49-4fd2-bc40-b228a86b2754 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:14.237006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d91040aa-8297-4fda-83e6-f586e634e826 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:14.237618 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d91040aa-8297-4fda-83e6-f586e634e826 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:14.241743 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ab78c5b8-9c49-4fd2-bc40-b228a86b2754 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:14.242231 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ab78c5b8-9c49-4fd2-bc40-b228a86b2754 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:14.242669 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ab78c5b8-9c49-4fd2-bc40-b228a86b2754 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:14.243367 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ab78c5b8-9c49-4fd2-bc40-b228a86b2754 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:14.243853 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ab78c5b8-9c49-4fd2-bc40-b228a86b2754 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:14.243984 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d91040aa-8297-4fda-83e6-f586e634e826 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:14.244280 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ab78c5b8-9c49-4fd2-bc40-b228a86b2754 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:14.244510 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d91040aa-8297-4fda-83e6-f586e634e826 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:14.244957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d91040aa-8297-4fda-83e6-f586e634e826 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:14.245654 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d91040aa-8297-4fda-83e6-f586e634e826 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:14.246108 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d91040aa-8297-4fda-83e6-f586e634e826 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:14.246532 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d91040aa-8297-4fda-83e6-f586e634e826 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:14.441957 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ab78c5b8-9c49-4fd2-bc40-b228a86b2754 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:14.445044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d91040aa-8297-4fda-83e6-f586e634e826 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:14.450619 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ab78c5b8-9c49-4fd2-bc40-b228a86b2754 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.220329 Aug 24 12:36:14.451195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 232/471] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:14 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:14.453211 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d91040aa-8297-4fda-83e6-f586e634e826 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 200 len: 1367 microversion: 2.1 time: 0.220370 Aug 24 12:36:14.453768 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 240/472] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:14 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:15.472417 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0fd7785c-e267-4c45-a6e5-5f1439212ab2 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:15.473030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0fd7785c-e267-4c45-a6e5-5f1439212ab2 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:15.473715 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-699d5866-f469-40c0-9fb3-bfc2e53d16f0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:15.474346 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-699d5866-f469-40c0-9fb3-bfc2e53d16f0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:15.479776 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fd7785c-e267-4c45-a6e5-5f1439212ab2 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:15.480266 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fd7785c-e267-4c45-a6e5-5f1439212ab2 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:15.480706 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fd7785c-e267-4c45-a6e5-5f1439212ab2 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:15.481066 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-699d5866-f469-40c0-9fb3-bfc2e53d16f0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:15.481399 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fd7785c-e267-4c45-a6e5-5f1439212ab2 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:15.481542 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-699d5866-f469-40c0-9fb3-bfc2e53d16f0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:15.481854 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fd7785c-e267-4c45-a6e5-5f1439212ab2 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:15.481963 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-699d5866-f469-40c0-9fb3-bfc2e53d16f0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:15.482278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fd7785c-e267-4c45-a6e5-5f1439212ab2 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:15.482630 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-699d5866-f469-40c0-9fb3-bfc2e53d16f0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:15.483073 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-699d5866-f469-40c0-9fb3-bfc2e53d16f0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:15.483490 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-699d5866-f469-40c0-9fb3-bfc2e53d16f0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:15.684939 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-0fd7785c-e267-4c45-a6e5-5f1439212ab2 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:15.689211 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-699d5866-f469-40c0-9fb3-bfc2e53d16f0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:15.693279 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0fd7785c-e267-4c45-a6e5-5f1439212ab2 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.224643 Aug 24 12:36:15.693848 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 233/473] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:15 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:15.696979 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-699d5866-f469-40c0-9fb3-bfc2e53d16f0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 200 len: 1367 microversion: 2.1 time: 0.226970 Aug 24 12:36:15.697609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 241/474] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:15 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:16.715502 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a51b5e43-f978-461a-936e-40fafd113640 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:16.716160 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a51b5e43-f978-461a-936e-40fafd113640 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:16.717199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7592c527-a4b0-4c55-9599-22553ff2dec0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:16.717809 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-7592c527-a4b0-4c55-9599-22553ff2dec0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:16.722689 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a51b5e43-f978-461a-936e-40fafd113640 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:16.723682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a51b5e43-f978-461a-936e-40fafd113640 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:16.723845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a51b5e43-f978-461a-936e-40fafd113640 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:16.724510 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7592c527-a4b0-4c55-9599-22553ff2dec0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:16.724633 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a51b5e43-f978-461a-936e-40fafd113640 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:16.724977 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a51b5e43-f978-461a-936e-40fafd113640 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:16.725108 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7592c527-a4b0-4c55-9599-22553ff2dec0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:16.725400 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7592c527-a4b0-4c55-9599-22553ff2dec0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:16.725511 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a51b5e43-f978-461a-936e-40fafd113640 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:16.726081 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7592c527-a4b0-4c55-9599-22553ff2dec0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:16.726523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7592c527-a4b0-4c55-9599-22553ff2dec0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:16.727116 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7592c527-a4b0-4c55-9599-22553ff2dec0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:16.932746 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a51b5e43-f978-461a-936e-40fafd113640 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:16.936163 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-7592c527-a4b0-4c55-9599-22553ff2dec0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:16.941314 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a51b5e43-f978-461a-936e-40fafd113640 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.230071 Aug 24 12:36:16.941973 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 234/475] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:16 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:16.947328 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-7592c527-a4b0-4c55-9599-22553ff2dec0 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 200 len: 1367 microversion: 2.1 time: 0.230535 Aug 24 12:36:16.947328 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 242/476] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:16 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:16.947839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-960c5f33-894d-4418-8f9b-2d761fedf79b req-b69e5881-4978-4f40-be58-ddcbf06c4acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871692ae-90bf-465a-ba88-24cfd077e5de", "name": "network-vif-plugged", "status": "completed", "tag": "7e0ebfc0-7898-40d1-8443-1a6da286d30e"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:16.956045 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-960c5f33-894d-4418-8f9b-2d761fedf79b req-b69e5881-4978-4f40-be58-ddcbf06c4acb service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:16.956521 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-960c5f33-894d-4418-8f9b-2d761fedf79b req-b69e5881-4978-4f40-be58-ddcbf06c4acb service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:16.956951 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-960c5f33-894d-4418-8f9b-2d761fedf79b req-b69e5881-4978-4f40-be58-ddcbf06c4acb service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:16.967885 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-960c5f33-894d-4418-8f9b-2d761fedf79b req-b69e5881-4978-4f40-be58-ddcbf06c4acb service nova] Creating event network-vif-plugged:7e0ebfc0-7898-40d1-8443-1a6da286d30e for instance 871692ae-90bf-465a-ba88-24cfd077e5de on hv-cinder-84890 Aug 24 12:36:16.972768 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-960c5f33-894d-4418-8f9b-2d761fedf79b req-b69e5881-4978-4f40-be58-ddcbf06c4acb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029638 Aug 24 12:36:16.973412 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 235/477] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:17.962140 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b4cf267e-f013-4402-b844-dbf25ff4c358 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:17.962674 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b4cf267e-f013-4402-b844-dbf25ff4c358 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:17.966151 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2e6b0ee1-ac09-4fad-ba74-dfa00b379f3e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:17.966851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2e6b0ee1-ac09-4fad-ba74-dfa00b379f3e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:17.969870 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4cf267e-f013-4402-b844-dbf25ff4c358 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:17.970342 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4cf267e-f013-4402-b844-dbf25ff4c358 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:17.970769 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4cf267e-f013-4402-b844-dbf25ff4c358 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:17.971450 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4cf267e-f013-4402-b844-dbf25ff4c358 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:17.971919 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4cf267e-f013-4402-b844-dbf25ff4c358 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:17.972333 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4cf267e-f013-4402-b844-dbf25ff4c358 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:17.972910 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2e6b0ee1-ac09-4fad-ba74-dfa00b379f3e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:17.973400 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2e6b0ee1-ac09-4fad-ba74-dfa00b379f3e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:17.973838 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2e6b0ee1-ac09-4fad-ba74-dfa00b379f3e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:17.974535 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2e6b0ee1-ac09-4fad-ba74-dfa00b379f3e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:17.974987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2e6b0ee1-ac09-4fad-ba74-dfa00b379f3e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:17.975409 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2e6b0ee1-ac09-4fad-ba74-dfa00b379f3e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:18.164113 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b4cf267e-f013-4402-b844-dbf25ff4c358 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:18.166776 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2e6b0ee1-ac09-4fad-ba74-dfa00b379f3e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:18.172857 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b4cf267e-f013-4402-b844-dbf25ff4c358 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.214642 Aug 24 12:36:18.173427 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 243/478] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:17 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:18.174336 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2e6b0ee1-ac09-4fad-ba74-dfa00b379f3e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 200 len: 1367 microversion: 2.1 time: 0.213441 Aug 24 12:36:18.174967 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 236/479] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:17 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:19.195760 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-17ea4765-a037-4afd-b206-b68d677fb745 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:19.196323 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a17890ba-2a3d-4819-b849-f8e1a094cdfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:19.196688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-17ea4765-a037-4afd-b206-b68d677fb745 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:19.196778 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a17890ba-2a3d-4819-b849-f8e1a094cdfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:19.198837 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:19.199002 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:19.199490 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=10 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:19.205409 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a17890ba-2a3d-4819-b849-f8e1a094cdfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:19.205897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a17890ba-2a3d-4819-b849-f8e1a094cdfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:19.206013 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-17ea4765-a037-4afd-b206-b68d677fb745 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:19.206337 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a17890ba-2a3d-4819-b849-f8e1a094cdfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:19.206486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-17ea4765-a037-4afd-b206-b68d677fb745 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:19.206792 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-17ea4765-a037-4afd-b206-b68d677fb745 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:19.207030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a17890ba-2a3d-4819-b849-f8e1a094cdfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:19.207476 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-17ea4765-a037-4afd-b206-b68d677fb745 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:19.207571 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a17890ba-2a3d-4819-b849-f8e1a094cdfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:19.207927 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a17890ba-2a3d-4819-b849-f8e1a094cdfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:19.208046 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-17ea4765-a037-4afd-b206-b68d677fb745 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:19.208358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-17ea4765-a037-4afd-b206-b68d677fb745 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:19.403528 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a17890ba-2a3d-4819-b849-f8e1a094cdfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:19.407744 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-17ea4765-a037-4afd-b206-b68d677fb745 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:19.411505 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a17890ba-2a3d-4819-b849-f8e1a094cdfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 200 len: 1557 microversion: 2.1 time: 0.219587 Aug 24 12:36:19.412106 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 237/480] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:19 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:19.416551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-17ea4765-a037-4afd-b206-b68d677fb745 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.224367 Aug 24 12:36:19.417285 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 244/481] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:19 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:19.432640 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2dac1d2d-21a1-4df4-b30c-a6537d00087b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:19.433123 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2dac1d2d-21a1-4df4-b30c-a6537d00087b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:19.439155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2dac1d2d-21a1-4df4-b30c-a6537d00087b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:19.439649 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2dac1d2d-21a1-4df4-b30c-a6537d00087b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:19.440089 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2dac1d2d-21a1-4df4-b30c-a6537d00087b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:19.440774 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2dac1d2d-21a1-4df4-b30c-a6537d00087b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:19.441223 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2dac1d2d-21a1-4df4-b30c-a6537d00087b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:19.441639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2dac1d2d-21a1-4df4-b30c-a6537d00087b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:19.520687 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2dac1d2d-21a1-4df4-b30c-a6537d00087b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091753 Aug 24 12:36:19.521286 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 238/482] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 12:36:19 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:36:20.437981 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2389317d-997a-4867-ada9-b88349966558 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:20.438535 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2389317d-997a-4867-ada9-b88349966558 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:20.444784 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2389317d-997a-4867-ada9-b88349966558 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:20.445272 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2389317d-997a-4867-ada9-b88349966558 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:20.445706 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2389317d-997a-4867-ada9-b88349966558 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:20.446403 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2389317d-997a-4867-ada9-b88349966558 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:20.446855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2389317d-997a-4867-ada9-b88349966558 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:20.447276 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2389317d-997a-4867-ada9-b88349966558 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:20.657608 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2389317d-997a-4867-ada9-b88349966558 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:20.665855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2389317d-997a-4867-ada9-b88349966558 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.231857 Aug 24 12:36:20.666476 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 245/483] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:20 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:20.716061 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-dceeee9f-841b-4f17-8461-5d0b00c22642 req-a7f4df2e-9f12-4ac1-99a2-a829df64197f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871692ae-90bf-465a-ba88-24cfd077e5de", "tag": "7e0ebfc0-7898-40d1-8443-1a6da286d30e"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:20.725563 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-dceeee9f-841b-4f17-8461-5d0b00c22642 req-a7f4df2e-9f12-4ac1-99a2-a829df64197f service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:20.726042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-dceeee9f-841b-4f17-8461-5d0b00c22642 req-a7f4df2e-9f12-4ac1-99a2-a829df64197f service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:20.726471 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-dceeee9f-841b-4f17-8461-5d0b00c22642 req-a7f4df2e-9f12-4ac1-99a2-a829df64197f service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:20.738076 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-dceeee9f-841b-4f17-8461-5d0b00c22642 req-a7f4df2e-9f12-4ac1-99a2-a829df64197f service nova] Creating event network-changed:7e0ebfc0-7898-40d1-8443-1a6da286d30e for instance 871692ae-90bf-465a-ba88-24cfd077e5de on hv-cinder-84890 Aug 24 12:36:20.742871 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-dceeee9f-841b-4f17-8461-5d0b00c22642 req-a7f4df2e-9f12-4ac1-99a2-a829df64197f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031905 Aug 24 12:36:20.743463 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 239/484] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:21.687819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-612b1630-d6e9-4284-baf6-e3e48796db62 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:21.688344 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-612b1630-d6e9-4284-baf6-e3e48796db62 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:21.694517 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-612b1630-d6e9-4284-baf6-e3e48796db62 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:21.694993 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-612b1630-d6e9-4284-baf6-e3e48796db62 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:21.695420 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-612b1630-d6e9-4284-baf6-e3e48796db62 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:21.696126 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-612b1630-d6e9-4284-baf6-e3e48796db62 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:21.696574 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-612b1630-d6e9-4284-baf6-e3e48796db62 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:21.696986 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-612b1630-d6e9-4284-baf6-e3e48796db62 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:21.840282 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-612b1630-d6e9-4284-baf6-e3e48796db62 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:21.848715 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-612b1630-d6e9-4284-baf6-e3e48796db62 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.164804 Aug 24 12:36:21.849298 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 246/485] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:21 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:22.042939 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3c14c3fc-22ac-4586-b352-46861862c635 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:22.043508 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3c14c3fc-22ac-4586-b352-46861862c635 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:22.046141 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:22.051859 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c14c3fc-22ac-4586-b352-46861862c635 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:22.052364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c14c3fc-22ac-4586-b352-46861862c635 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:22.052808 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c14c3fc-22ac-4586-b352-46861862c635 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:22.053514 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c14c3fc-22ac-4586-b352-46861862c635 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:22.053974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c14c3fc-22ac-4586-b352-46861862c635 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:22.054401 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c14c3fc-22ac-4586-b352-46861862c635 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:22.136541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.objects.instance [None req-3c14c3fc-22ac-4586-b352-46861862c635 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lazy-loading 'services' on Instance uuid c2cf1c28-43da-4dce-9f29-d2a486ef88ab {{(pid=127307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:36:22.206371 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3c14c3fc-22ac-4586-b352-46861862c635 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/os-volume_attachments/1b2f545c-d822-460f-80b9-5a6852b6b06e" status: 202 len: 0 microversion: 2.1 time: 0.169181 Aug 24 12:36:22.206908 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 240/486] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 12:36:22 2022] DELETE /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/os-volume_attachments/1b2f545c-d822-460f-80b9-5a6852b6b06e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:36:22.869638 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-617fe1bf-adac-44bc-a73a-4c3cc4c1b29e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:22.870157 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-617fe1bf-adac-44bc-a73a-4c3cc4c1b29e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:22.876663 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-617fe1bf-adac-44bc-a73a-4c3cc4c1b29e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:22.877141 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-617fe1bf-adac-44bc-a73a-4c3cc4c1b29e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:22.877574 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-617fe1bf-adac-44bc-a73a-4c3cc4c1b29e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:22.878251 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-617fe1bf-adac-44bc-a73a-4c3cc4c1b29e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:22.878698 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-617fe1bf-adac-44bc-a73a-4c3cc4c1b29e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:22.879115 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-617fe1bf-adac-44bc-a73a-4c3cc4c1b29e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:23.012705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-617fe1bf-adac-44bc-a73a-4c3cc4c1b29e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:23.020973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-617fe1bf-adac-44bc-a73a-4c3cc4c1b29e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1734 microversion: 2.1 time: 0.155207 Aug 24 12:36:23.021585 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 247/487] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:22 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:24.044902 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-cbe7bb44-1a6b-441b-b830-0094c0ab4971 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:24.045681 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-cbe7bb44-1a6b-441b-b830-0094c0ab4971 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:24.052134 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cbe7bb44-1a6b-441b-b830-0094c0ab4971 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:24.052616 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cbe7bb44-1a6b-441b-b830-0094c0ab4971 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:24.053051 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cbe7bb44-1a6b-441b-b830-0094c0ab4971 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:24.053771 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cbe7bb44-1a6b-441b-b830-0094c0ab4971 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:24.054390 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cbe7bb44-1a6b-441b-b830-0094c0ab4971 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:24.055967 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cbe7bb44-1a6b-441b-b830-0094c0ab4971 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:24.194097 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-cbe7bb44-1a6b-441b-b830-0094c0ab4971 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:24.202514 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-cbe7bb44-1a6b-441b-b830-0094c0ab4971 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1714 microversion: 2.1 time: 0.163807 Aug 24 12:36:24.203066 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 241/488] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:24 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1714 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:24.309140 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f272f11b-15ea-4f80-ad1e-45f40c021631 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:24.309635 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f272f11b-15ea-4f80-ad1e-45f40c021631 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:24.316016 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f272f11b-15ea-4f80-ad1e-45f40c021631 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:24.316498 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f272f11b-15ea-4f80-ad1e-45f40c021631 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:24.316931 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f272f11b-15ea-4f80-ad1e-45f40c021631 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:24.317618 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f272f11b-15ea-4f80-ad1e-45f40c021631 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:24.318130 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f272f11b-15ea-4f80-ad1e-45f40c021631 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:24.318562 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f272f11b-15ea-4f80-ad1e-45f40c021631 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:24.376995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ae11b033-5685-44d5-bdff-d053c98beec6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:24.383230 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ae11b033-5685-44d5-bdff-d053c98beec6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:24.383749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ae11b033-5685-44d5-bdff-d053c98beec6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:24.384180 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ae11b033-5685-44d5-bdff-d053c98beec6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:24.407633 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ae11b033-5685-44d5-bdff-d053c98beec6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Going to try to stop instance {{(pid=127307) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 12:36:24.444999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-f272f11b-15ea-4f80-ad1e-45f40c021631 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] HTTP exception thrown: Cannot 'detach_volume' instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 while it is in vm_state rescued Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f272f11b-15ea-4f80-ad1e-45f40c021631 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Request method failure captured: Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: DELETE /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/os-volume_attachments/672e6b28-87a7-4ef0-bdaa-93802933fe21 HTTP/1.1 Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhptNH4mn2TVQcU78gzQc_MEi0EjKa375myyVyDI0kkHg9_so0vJnb2xQ2TdCUf0V4s8LQu4JeSt7iwuhXjPBZKJOkVhmKBO25mKo4XuZDYED7arR8J9UwMqw0S3d9pXZhfromF_FuF00GG74qKZE1M9iai6jJhDaaYLQDZCCnQB9j8 Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 9afa0216c9e140bb82f56f14ccfb7bb6 Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1748371241 Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:36:24.446828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:36:24.449544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:36:24.449544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1748371241 Aug 24 12:36:24.449544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 9afa0216c9e140bb82f56f14ccfb7bb6 Aug 24 12:36:24.449544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1748371241 Aug 24 12:36:24.449544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-ServerRescueNegativeTestJSON-1748371241-project Aug 24 12:36:24.449544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:36:24.449544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:36:24.449544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 9138ac21bbdb4577a7f43b5ab471d572 Aug 24 12:36:24.449544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1748371241-project Aug 24 12:36:24.449544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:36:24.449544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Cannot 'detach_volume' instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 while it is in vm_state rescued Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'server_id': '06fdcfd7-6650-4fe4-8c3a-746ea58f0409', 'id': '672e6b28-87a7-4ef0-bdaa-93802933fe21'} Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:36:24.450546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 while it is in vm_state rescued Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 while it is in vm_state rescued Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:36:24.452377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f272f11b-15ea-4f80-ad1e-45f40c021631 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Returning 409 to user: Cannot 'detach_volume' instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 while it is in vm_state rescued {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:36:24.454207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f272f11b-15ea-4f80-ad1e-45f40c021631 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "DELETE /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/os-volume_attachments/672e6b28-87a7-4ef0-bdaa-93802933fe21" status: 409 len: 152 microversion: 2.1 time: 0.143894 Aug 24 12:36:24.454207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 248/489] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 12:36:24 2022] DELETE /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/os-volume_attachments/672e6b28-87a7-4ef0-bdaa-93802933fe21 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 12:36:24.458830 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ce21960e-90f1-4981-baaa-cc8d7d23ca6e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:24.459363 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-ce21960e-90f1-4981-baaa-cc8d7d23ca6e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:24.459877 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ae11b033-5685-44d5-bdff-d053c98beec6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "POST /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/action" status: 202 len: 0 microversion: 2.1 time: 0.086453 Aug 24 12:36:24.460483 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 242/490] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 12:36:24 2022] POST /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:36:24.468050 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce21960e-90f1-4981-baaa-cc8d7d23ca6e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:24.468544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce21960e-90f1-4981-baaa-cc8d7d23ca6e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:24.468979 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce21960e-90f1-4981-baaa-cc8d7d23ca6e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:24.469679 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce21960e-90f1-4981-baaa-cc8d7d23ca6e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:24.469794 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2a207e74-177c-4261-b2bd-5b4009339ebc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:24.470138 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce21960e-90f1-4981-baaa-cc8d7d23ca6e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:24.470561 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce21960e-90f1-4981-baaa-cc8d7d23ca6e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:24.470677 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2a207e74-177c-4261-b2bd-5b4009339ebc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:24.476965 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2a207e74-177c-4261-b2bd-5b4009339ebc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:24.477584 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2a207e74-177c-4261-b2bd-5b4009339ebc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:24.478016 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2a207e74-177c-4261-b2bd-5b4009339ebc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:24.478963 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2a207e74-177c-4261-b2bd-5b4009339ebc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:24.479770 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2a207e74-177c-4261-b2bd-5b4009339ebc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:24.480209 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2a207e74-177c-4261-b2bd-5b4009339ebc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:24.541903 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-ce21960e-90f1-4981-baaa-cc8d7d23ca6e tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "POST /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/action" status: 202 len: 0 microversion: 2.1 time: 0.086775 Aug 24 12:36:24.542735 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 249/491] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 12:36:24 2022] POST /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:36:24.552524 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b4619f39-3b4f-4161-9858-f57b85f38f25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:24.553234 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b4619f39-3b4f-4161-9858-f57b85f38f25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:24.559932 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4619f39-3b4f-4161-9858-f57b85f38f25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:24.560428 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4619f39-3b4f-4161-9858-f57b85f38f25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:24.560870 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4619f39-3b4f-4161-9858-f57b85f38f25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:24.561565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4619f39-3b4f-4161-9858-f57b85f38f25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:24.562021 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4619f39-3b4f-4161-9858-f57b85f38f25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:24.562456 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4619f39-3b4f-4161-9858-f57b85f38f25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:24.626176 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2a207e74-177c-4261-b2bd-5b4009339ebc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:24.635216 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2a207e74-177c-4261-b2bd-5b4009339ebc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1675 microversion: 2.1 time: 0.168851 Aug 24 12:36:24.636202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 243/492] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:24 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:24.712490 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b4619f39-3b4f-4161-9858-f57b85f38f25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:24.722593 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b4619f39-3b4f-4161-9858-f57b85f38f25 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1722 microversion: 2.1 time: 0.174579 Aug 24 12:36:24.722999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 250/493] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:24 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:25.657149 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-26f73f89-f3a7-489f-a6b8-1596d49a1285 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:25.657758 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-26f73f89-f3a7-489f-a6b8-1596d49a1285 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:25.663939 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-26f73f89-f3a7-489f-a6b8-1596d49a1285 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:25.664454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-26f73f89-f3a7-489f-a6b8-1596d49a1285 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:25.664897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-26f73f89-f3a7-489f-a6b8-1596d49a1285 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:25.665587 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-26f73f89-f3a7-489f-a6b8-1596d49a1285 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:25.666161 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-26f73f89-f3a7-489f-a6b8-1596d49a1285 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:25.666709 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-26f73f89-f3a7-489f-a6b8-1596d49a1285 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:25.743971 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-5e39cdbb-271d-4985-983a-33752a6e43a8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:25.745365 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-5e39cdbb-271d-4985-983a-33752a6e43a8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:25.748284 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:25.753462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5e39cdbb-271d-4985-983a-33752a6e43a8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:25.753982 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5e39cdbb-271d-4985-983a-33752a6e43a8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:25.754421 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5e39cdbb-271d-4985-983a-33752a6e43a8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:25.755122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5e39cdbb-271d-4985-983a-33752a6e43a8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:25.755577 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5e39cdbb-271d-4985-983a-33752a6e43a8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:25.756032 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5e39cdbb-271d-4985-983a-33752a6e43a8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:25.806007 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-26f73f89-f3a7-489f-a6b8-1596d49a1285 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:25.814244 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-26f73f89-f3a7-489f-a6b8-1596d49a1285 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1675 microversion: 2.1 time: 0.161154 Aug 24 12:36:25.814890 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 244/494] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:25 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:25.892832 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-5e39cdbb-271d-4985-983a-33752a6e43a8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:25.902061 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-5e39cdbb-271d-4985-983a-33752a6e43a8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1722 microversion: 2.1 time: 0.161874 Aug 24 12:36:25.902618 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 251/495] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:25 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:25.906368 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-eb1d368d-6416-42e3-8b80-7b0f01cf6aab tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:25.906886 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-eb1d368d-6416-42e3-8b80-7b0f01cf6aab tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:25.912931 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-eb1d368d-6416-42e3-8b80-7b0f01cf6aab tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:25.913356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-eb1d368d-6416-42e3-8b80-7b0f01cf6aab tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:25.913791 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-eb1d368d-6416-42e3-8b80-7b0f01cf6aab tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:25.914484 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-eb1d368d-6416-42e3-8b80-7b0f01cf6aab tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:25.914935 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-eb1d368d-6416-42e3-8b80-7b0f01cf6aab tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:25.915358 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-eb1d368d-6416-42e3-8b80-7b0f01cf6aab tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:25.944635 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-eb1d368d-6416-42e3-8b80-7b0f01cf6aab tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/os-volume_attachments/3867e945-5671-4ec1-bc0e-90aff8bf8371" status: 200 len: 194 microversion: 2.20 time: 0.045464 Aug 24 12:36:25.945197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 245/496] 10.222.0.58 () {60 vars in 1454 bytes} [Wed Aug 24 12:36:25 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/os-volume_attachments/3867e945-5671-4ec1-bc0e-90aff8bf8371 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:36:26.018587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e56ca6aa-31a1-44fb-9751-07e8a986af3f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:26.019073 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e56ca6aa-31a1-44fb-9751-07e8a986af3f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:26.025052 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e56ca6aa-31a1-44fb-9751-07e8a986af3f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:26.025604 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e56ca6aa-31a1-44fb-9751-07e8a986af3f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:26.026084 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e56ca6aa-31a1-44fb-9751-07e8a986af3f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:26.026760 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e56ca6aa-31a1-44fb-9751-07e8a986af3f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:26.027208 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e56ca6aa-31a1-44fb-9751-07e8a986af3f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:26.027646 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e56ca6aa-31a1-44fb-9751-07e8a986af3f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:26.107108 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-e56ca6aa-31a1-44fb-9751-07e8a986af3f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lazy-loading 'services' on Instance uuid e09b5ebb-0578-465d-a6ad-03383fdeca05 {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:36:26.140398 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:26.222250 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e56ca6aa-31a1-44fb-9751-07e8a986af3f tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/os-volume_attachments/3867e945-5671-4ec1-bc0e-90aff8bf8371" status: 202 len: 0 microversion: 2.20 time: 0.207420 Aug 24 12:36:26.222966 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 252/497] 10.222.0.58 () {60 vars in 1457 bytes} [Wed Aug 24 12:36:26 2022] DELETE /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/os-volume_attachments/3867e945-5671-4ec1-bc0e-90aff8bf8371 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:36:26.231874 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-66312726-4706-468d-b72d-ec4a1f1e1218 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:26.234168 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-66312726-4706-468d-b72d-ec4a1f1e1218 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:26.240062 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66312726-4706-468d-b72d-ec4a1f1e1218 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:26.240540 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66312726-4706-468d-b72d-ec4a1f1e1218 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:26.240970 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66312726-4706-468d-b72d-ec4a1f1e1218 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:26.241654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66312726-4706-468d-b72d-ec4a1f1e1218 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:26.242106 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66312726-4706-468d-b72d-ec4a1f1e1218 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:26.242531 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66312726-4706-468d-b72d-ec4a1f1e1218 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:26.272365 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-66312726-4706-468d-b72d-ec4a1f1e1218 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044949 Aug 24 12:36:26.273025 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 246/498] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 12:36:26 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:36:26.839104 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b3811045-64a8-41d7-9f21-d01f3b4ea529 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:26.839862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b3811045-64a8-41d7-9f21-d01f3b4ea529 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:26.846181 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b3811045-64a8-41d7-9f21-d01f3b4ea529 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:26.846666 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b3811045-64a8-41d7-9f21-d01f3b4ea529 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:26.847103 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b3811045-64a8-41d7-9f21-d01f3b4ea529 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:26.847830 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b3811045-64a8-41d7-9f21-d01f3b4ea529 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:26.848286 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b3811045-64a8-41d7-9f21-d01f3b4ea529 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:26.848709 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b3811045-64a8-41d7-9f21-d01f3b4ea529 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:26.922606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-91a775dc-61fd-4e3d-855c-dd23cf766544 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:26.923222 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-91a775dc-61fd-4e3d-855c-dd23cf766544 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:26.929608 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-91a775dc-61fd-4e3d-855c-dd23cf766544 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:26.930104 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-91a775dc-61fd-4e3d-855c-dd23cf766544 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:26.930581 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-91a775dc-61fd-4e3d-855c-dd23cf766544 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:26.931272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-91a775dc-61fd-4e3d-855c-dd23cf766544 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:26.931801 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-91a775dc-61fd-4e3d-855c-dd23cf766544 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:26.932411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-91a775dc-61fd-4e3d-855c-dd23cf766544 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:26.948085 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:27.010463 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b3811045-64a8-41d7-9f21-d01f3b4ea529 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:27.018156 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b3811045-64a8-41d7-9f21-d01f3b4ea529 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1675 microversion: 2.1 time: 0.184805 Aug 24 12:36:27.019029 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 253/499] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:26 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:27.074436 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-91a775dc-61fd-4e3d-855c-dd23cf766544 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:27.082773 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-91a775dc-61fd-4e3d-855c-dd23cf766544 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1722 microversion: 2.1 time: 0.164122 Aug 24 12:36:27.083334 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 247/500] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:26 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:27.285896 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c848b365-6646-4e4b-a8e1-64ef2365ff21 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:27.288059 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c848b365-6646-4e4b-a8e1-64ef2365ff21 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:27.294563 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c848b365-6646-4e4b-a8e1-64ef2365ff21 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:27.295053 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c848b365-6646-4e4b-a8e1-64ef2365ff21 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:27.295691 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c848b365-6646-4e4b-a8e1-64ef2365ff21 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:27.296387 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c848b365-6646-4e4b-a8e1-64ef2365ff21 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:27.296838 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c848b365-6646-4e4b-a8e1-64ef2365ff21 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:27.297250 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c848b365-6646-4e4b-a8e1-64ef2365ff21 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:27.329456 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c848b365-6646-4e4b-a8e1-64ef2365ff21 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047483 Aug 24 12:36:27.330030 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 254/501] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 12:36:27 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:36:28.038587 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-22740337-d850-4396-86ae-2b5e6fcd44ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:28.039091 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-22740337-d850-4396-86ae-2b5e6fcd44ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:28.046218 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-22740337-d850-4396-86ae-2b5e6fcd44ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.046695 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-22740337-d850-4396-86ae-2b5e6fcd44ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.047126 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-22740337-d850-4396-86ae-2b5e6fcd44ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.048046 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-22740337-d850-4396-86ae-2b5e6fcd44ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.048498 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-22740337-d850-4396-86ae-2b5e6fcd44ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.048932 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-22740337-d850-4396-86ae-2b5e6fcd44ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.105008 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-6ba9694a-3ea9-4647-88b2-c02f46cdfda9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:28.105767 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-6ba9694a-3ea9-4647-88b2-c02f46cdfda9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:28.112372 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6ba9694a-3ea9-4647-88b2-c02f46cdfda9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.112935 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6ba9694a-3ea9-4647-88b2-c02f46cdfda9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.113445 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6ba9694a-3ea9-4647-88b2-c02f46cdfda9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.114204 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6ba9694a-3ea9-4647-88b2-c02f46cdfda9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.114831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6ba9694a-3ea9-4647-88b2-c02f46cdfda9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.115415 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6ba9694a-3ea9-4647-88b2-c02f46cdfda9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.228525 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-22740337-d850-4396-86ae-2b5e6fcd44ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:28.236441 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-22740337-d850-4396-86ae-2b5e6fcd44ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1675 microversion: 2.1 time: 0.201689 Aug 24 12:36:28.237008 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 248/502] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:28 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1675 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:28.273741 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6ba9694a-3ea9-4647-88b2-c02f46cdfda9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:28.282751 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-6ba9694a-3ea9-4647-88b2-c02f46cdfda9 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1728 microversion: 2.1 time: 0.182814 Aug 24 12:36:28.283316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 255/503] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:28 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:28.303304 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a4e9ebd7-e97d-442d-9b95-d6ff5a268d4a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:28.303836 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a4e9ebd7-e97d-442d-9b95-d6ff5a268d4a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:28.309809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4e9ebd7-e97d-442d-9b95-d6ff5a268d4a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.310295 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4e9ebd7-e97d-442d-9b95-d6ff5a268d4a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.310731 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4e9ebd7-e97d-442d-9b95-d6ff5a268d4a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.311424 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4e9ebd7-e97d-442d-9b95-d6ff5a268d4a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.311921 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4e9ebd7-e97d-442d-9b95-d6ff5a268d4a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.312352 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4e9ebd7-e97d-442d-9b95-d6ff5a268d4a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.342055 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a79a92b9-88ea-48a2-bd59-2d1e465a7a06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:28.344375 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-a79a92b9-88ea-48a2-bd59-2d1e465a7a06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:28.350387 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a79a92b9-88ea-48a2-bd59-2d1e465a7a06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.350902 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a79a92b9-88ea-48a2-bd59-2d1e465a7a06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.351343 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a79a92b9-88ea-48a2-bd59-2d1e465a7a06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.352076 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a79a92b9-88ea-48a2-bd59-2d1e465a7a06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.352528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a79a92b9-88ea-48a2-bd59-2d1e465a7a06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.352982 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a79a92b9-88ea-48a2-bd59-2d1e465a7a06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.381805 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a79a92b9-88ea-48a2-bd59-2d1e465a7a06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044316 Aug 24 12:36:28.382364 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 256/504] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 12:36:28 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:28.394454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a4e9ebd7-e97d-442d-9b95-d6ff5a268d4a tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094942 Aug 24 12:36:28.395042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 249/505] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 12:36:28 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:28.445726 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-0a73342e-913d-47e8-aa07-14f55d41189b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:28.446345 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-0a73342e-913d-47e8-aa07-14f55d41189b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:28.453213 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0a73342e-913d-47e8-aa07-14f55d41189b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.453695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0a73342e-913d-47e8-aa07-14f55d41189b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.454132 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0a73342e-913d-47e8-aa07-14f55d41189b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.454820 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0a73342e-913d-47e8-aa07-14f55d41189b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.455272 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0a73342e-913d-47e8-aa07-14f55d41189b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.455798 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0a73342e-913d-47e8-aa07-14f55d41189b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.481011 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-0a73342e-913d-47e8-aa07-14f55d41189b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Going to try to terminate instance {{(pid=127308) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:36:28.558911 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-0a73342e-913d-47e8-aa07-14f55d41189b tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 204 len: 0 microversion: 2.20 time: 0.116611 Aug 24 12:36:28.559374 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 257/506] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 12:36:28 2022] DELETE /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 12:36:28.567697 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5d37d551-0d87-4a96-8a70-c04789e81f63 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:28.568308 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5d37d551-0d87-4a96-8a70-c04789e81f63 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:28.574861 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5d37d551-0d87-4a96-8a70-c04789e81f63 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.575338 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5d37d551-0d87-4a96-8a70-c04789e81f63 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.575805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5d37d551-0d87-4a96-8a70-c04789e81f63 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.576767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5d37d551-0d87-4a96-8a70-c04789e81f63 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.577193 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5d37d551-0d87-4a96-8a70-c04789e81f63 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.577609 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5d37d551-0d87-4a96-8a70-c04789e81f63 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.812851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5d37d551-0d87-4a96-8a70-c04789e81f63 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:28.821543 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5d37d551-0d87-4a96-8a70-c04789e81f63 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:28.823706 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5d37d551-0d87-4a96-8a70-c04789e81f63 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:28.824877 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5d37d551-0d87-4a96-8a70-c04789e81f63 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.261000 Aug 24 12:36:28.825423 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 250/507] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:28 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:36:29.259423 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b59c4167-9bd4-4bed-9ab6-41cef44c8f8a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:29.260499 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b59c4167-9bd4-4bed-9ab6-41cef44c8f8a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:29.267528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b59c4167-9bd4-4bed-9ab6-41cef44c8f8a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:29.267743 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b59c4167-9bd4-4bed-9ab6-41cef44c8f8a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:29.268057 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b59c4167-9bd4-4bed-9ab6-41cef44c8f8a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:29.268755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b59c4167-9bd4-4bed-9ab6-41cef44c8f8a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:29.269248 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b59c4167-9bd4-4bed-9ab6-41cef44c8f8a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:29.269664 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b59c4167-9bd4-4bed-9ab6-41cef44c8f8a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:29.338147 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-d8e06248-0f01-4f88-94b4-29ef5a4c1850 req-8a6393c9-7b60-404c-9ff0-c6ada2aa4188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fdcfd7-6650-4fe4-8c3a-746ea58f0409", "tag": "93921963-7c18-4787-bce0-01c4d4b2201a"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:29.348689 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-d8e06248-0f01-4f88-94b4-29ef5a4c1850 req-8a6393c9-7b60-404c-9ff0-c6ada2aa4188 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:29.349415 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-d8e06248-0f01-4f88-94b4-29ef5a4c1850 req-8a6393c9-7b60-404c-9ff0-c6ada2aa4188 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:29.349839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-d8e06248-0f01-4f88-94b4-29ef5a4c1850 req-8a6393c9-7b60-404c-9ff0-c6ada2aa4188 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:29.362078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-d8e06248-0f01-4f88-94b4-29ef5a4c1850 req-8a6393c9-7b60-404c-9ff0-c6ada2aa4188 service nova] Creating event network-changed:93921963-7c18-4787-bce0-01c4d4b2201a for instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 on hv-cinder-84890 Aug 24 12:36:29.368051 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-d8e06248-0f01-4f88-94b4-29ef5a4c1850 req-8a6393c9-7b60-404c-9ff0-c6ada2aa4188 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033818 Aug 24 12:36:29.369273 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 251/508] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:36:29.444618 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b59c4167-9bd4-4bed-9ab6-41cef44c8f8a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:29.453601 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b59c4167-9bd4-4bed-9ab6-41cef44c8f8a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1675 microversion: 2.1 time: 0.198482 Aug 24 12:36:29.454167 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 258/509] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:29 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1675 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:29.849758 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-cec17ea0-f41f-4ae1-ab56-a9509ffc1797 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:29.850469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-cec17ea0-f41f-4ae1-ab56-a9509ffc1797 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:29.859656 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cec17ea0-f41f-4ae1-ab56-a9509ffc1797 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:29.860280 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cec17ea0-f41f-4ae1-ab56-a9509ffc1797 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:29.860983 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cec17ea0-f41f-4ae1-ab56-a9509ffc1797 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:29.861923 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cec17ea0-f41f-4ae1-ab56-a9509ffc1797 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:29.862398 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cec17ea0-f41f-4ae1-ab56-a9509ffc1797 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:29.862921 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cec17ea0-f41f-4ae1-ab56-a9509ffc1797 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:30.006377 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-cec17ea0-f41f-4ae1-ab56-a9509ffc1797 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:30.015190 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-cec17ea0-f41f-4ae1-ab56-a9509ffc1797 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:30.016751 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-cec17ea0-f41f-4ae1-ab56-a9509ffc1797 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:30.017844 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-cec17ea0-f41f-4ae1-ab56-a9509ffc1797 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.172797 Aug 24 12:36:30.018397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 252/510] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:29 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:36:30.475222 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-19bf26a1-3f56-435a-a7aa-05bba247dd0a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:30.476899 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-19bf26a1-3f56-435a-a7aa-05bba247dd0a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:30.485437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-19bf26a1-3f56-435a-a7aa-05bba247dd0a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:30.485917 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-19bf26a1-3f56-435a-a7aa-05bba247dd0a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:30.486342 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-19bf26a1-3f56-435a-a7aa-05bba247dd0a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:30.487040 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-19bf26a1-3f56-435a-a7aa-05bba247dd0a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:30.487486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-19bf26a1-3f56-435a-a7aa-05bba247dd0a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:30.487926 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-19bf26a1-3f56-435a-a7aa-05bba247dd0a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:30.621164 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-19bf26a1-3f56-435a-a7aa-05bba247dd0a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:30.628911 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-19bf26a1-3f56-435a-a7aa-05bba247dd0a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1675 microversion: 2.1 time: 0.158346 Aug 24 12:36:30.629475 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 259/511] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:30 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:31.040605 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-7e375343-d578-4498-8a90-6a3fc5c66636 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:31.041952 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-7e375343-d578-4498-8a90-6a3fc5c66636 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:31.048739 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7e375343-d578-4498-8a90-6a3fc5c66636 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:31.049444 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7e375343-d578-4498-8a90-6a3fc5c66636 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:31.049914 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7e375343-d578-4498-8a90-6a3fc5c66636 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:31.050621 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7e375343-d578-4498-8a90-6a3fc5c66636 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:31.051074 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7e375343-d578-4498-8a90-6a3fc5c66636 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:31.051501 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7e375343-d578-4498-8a90-6a3fc5c66636 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:31.193230 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7e375343-d578-4498-8a90-6a3fc5c66636 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:31.202414 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7e375343-d578-4498-8a90-6a3fc5c66636 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:31.204101 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7e375343-d578-4498-8a90-6a3fc5c66636 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:31.205266 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-7e375343-d578-4498-8a90-6a3fc5c66636 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 200 len: 1724 microversion: 2.20 time: 0.168592 Aug 24 12:36:31.205826 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 253/512] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:31 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:31.383174 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-4d725666-d2ea-4d95-adb4-b944c70890fc req-414ddab0-41ee-464b-8b68-2a633cbbfc12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fdcfd7-6650-4fe4-8c3a-746ea58f0409", "tag": "93921963-7c18-4787-bce0-01c4d4b2201a"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:31.393649 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-4d725666-d2ea-4d95-adb4-b944c70890fc req-414ddab0-41ee-464b-8b68-2a633cbbfc12 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:31.394203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-4d725666-d2ea-4d95-adb4-b944c70890fc req-414ddab0-41ee-464b-8b68-2a633cbbfc12 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:31.394701 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-4d725666-d2ea-4d95-adb4-b944c70890fc req-414ddab0-41ee-464b-8b68-2a633cbbfc12 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:31.407527 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-4d725666-d2ea-4d95-adb4-b944c70890fc req-414ddab0-41ee-464b-8b68-2a633cbbfc12 service nova] Creating event network-changed:93921963-7c18-4787-bce0-01c4d4b2201a for instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 on hv-cinder-84890 Aug 24 12:36:31.412396 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-4d725666-d2ea-4d95-adb4-b944c70890fc req-414ddab0-41ee-464b-8b68-2a633cbbfc12 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032856 Aug 24 12:36:31.413055 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 260/513] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:31.580473 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-b6bcd51f-5703-4a86-9a6e-6cfec299a84c req-9e523cf7-3444-4f6c-93f9-83b475af3566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09b5ebb-0578-465d-a6ad-03383fdeca05", "name": "network-vif-deleted", "tag": "170ac04a-b7df-4c9d-939a-edc705e2589c"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:31.598007 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b6bcd51f-5703-4a86-9a6e-6cfec299a84c req-9e523cf7-3444-4f6c-93f9-83b475af3566 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:31.598926 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b6bcd51f-5703-4a86-9a6e-6cfec299a84c req-9e523cf7-3444-4f6c-93f9-83b475af3566 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:31.599357 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b6bcd51f-5703-4a86-9a6e-6cfec299a84c req-9e523cf7-3444-4f6c-93f9-83b475af3566 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:31.611720 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-b6bcd51f-5703-4a86-9a6e-6cfec299a84c req-9e523cf7-3444-4f6c-93f9-83b475af3566 service nova] Creating event network-vif-deleted:170ac04a-b7df-4c9d-939a-edc705e2589c for instance e09b5ebb-0578-465d-a6ad-03383fdeca05 on hv-cinder-84890 Aug 24 12:36:31.619691 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-b6bcd51f-5703-4a86-9a6e-6cfec299a84c req-9e523cf7-3444-4f6c-93f9-83b475af3566 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042558 Aug 24 12:36:31.625390 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 254/514] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:31.651459 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-284667f0-6be4-42d1-9468-86f4db55fffd tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:31.652786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-284667f0-6be4-42d1-9468-86f4db55fffd tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:31.659992 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-284667f0-6be4-42d1-9468-86f4db55fffd tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:31.660739 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-284667f0-6be4-42d1-9468-86f4db55fffd tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:31.661346 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-284667f0-6be4-42d1-9468-86f4db55fffd tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:31.662225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-284667f0-6be4-42d1-9468-86f4db55fffd tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:31.663046 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-284667f0-6be4-42d1-9468-86f4db55fffd tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:31.663691 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-284667f0-6be4-42d1-9468-86f4db55fffd tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:31.825074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-284667f0-6be4-42d1-9468-86f4db55fffd tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:31.834652 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-284667f0-6be4-42d1-9468-86f4db55fffd tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1675 microversion: 2.1 time: 0.187591 Aug 24 12:36:31.835320 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 261/515] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:31 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1675 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:32.229195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-969077b7-3bf8-48b4-916a-0573b32518d5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:32.230005 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-969077b7-3bf8-48b4-916a-0573b32518d5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:32.236730 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-969077b7-3bf8-48b4-916a-0573b32518d5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:32.237214 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-969077b7-3bf8-48b4-916a-0573b32518d5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:32.237865 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-969077b7-3bf8-48b4-916a-0573b32518d5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:32.238568 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-969077b7-3bf8-48b4-916a-0573b32518d5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:32.239026 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-969077b7-3bf8-48b4-916a-0573b32518d5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:32.239452 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-969077b7-3bf8-48b4-916a-0573b32518d5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:32.252881 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-969077b7-3bf8-48b4-916a-0573b32518d5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] HTTP exception thrown: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-969077b7-3bf8-48b4-916a-0573b32518d5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Request method failure captured: Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 HTTP/1.1 Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhplx9vIDtCGdDFFAVdrWbsbK7UFSa6YKTkdck275IH7y_8SPhXCYXZ1NCr2N8jds7FLyCnLM1I4cEXDwB-UUmQ5i0bQKYBGNDrvU9KIhgk4mW1oIvZT9U35gxW10HYEHXM0nyaJNOGGp4Wcdhh3g8tOxt83BZ0YkjKmZ0ecRcqlVlY Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: b38fa406b760405f8d3004db272f1e52 Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:36:32.254555 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:36:32.256277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b38fa406b760405f8d3004db272f1e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:36:32.256277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:36:32.256277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: b38fa406b760405f8d3004db272f1e52 Aug 24 12:36:32.256277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:36:32.256277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeShelveTestJSON-615962332-project Aug 24 12:36:32.256277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:36:32.256277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:36:32.256277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 28dac3ee2d5c4ff5ba2d15b59e57d2a7 Aug 24 12:36:32.256277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-615962332-project Aug 24 12:36:32.256277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:36:32.256277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. Aug 24 12:36:32.256277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': 'e09b5ebb-0578-465d-a6ad-03383fdeca05'} Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:36:32.257116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. Aug 24 12:36:32.258356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:36:32.259700 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-969077b7-3bf8-48b4-916a-0573b32518d5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Returning 404 to user: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:36:32.259700 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-969077b7-3bf8-48b4-916a-0573b32518d5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 404 len: 111 microversion: 2.20 time: 0.031528 Aug 24 12:36:32.259700 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 255/516] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:32 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:36:32.265087 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d2b426c2-e744-4941-b7a1-ff4fda819100 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '.version_select at 0x7f4696cb5310>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:32.284229 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d2b426c2-e744-4941-b7a1-ff4fda819100 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2013223063" status: 204 len: 0 microversion: 2.20 time: 0.022989 Aug 24 12:36:32.285173 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 262/517] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 24 12:36:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2013223063 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 12:36:32.857166 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a4df64fa-4c9b-4d71-9645-497309f56187 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:32.857780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a4df64fa-4c9b-4d71-9645-497309f56187 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:32.863898 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4df64fa-4c9b-4d71-9645-497309f56187 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:32.864393 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4df64fa-4c9b-4d71-9645-497309f56187 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:32.864832 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4df64fa-4c9b-4d71-9645-497309f56187 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:32.865528 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4df64fa-4c9b-4d71-9645-497309f56187 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:32.865985 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4df64fa-4c9b-4d71-9645-497309f56187 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:32.866410 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4df64fa-4c9b-4d71-9645-497309f56187 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:32.929424 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-07324884-5860-4324-8624-c3045a62c5d6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Action: 'create', calling method: .version_select at 0x7f4696cb1dc0>, body: {"keypair": {"name": "tempest-keypair-801442472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxoLYJWXF1A78MZct+FgEVpNvk4ew9Kh2jsO4WTjPJUsaPoJQGxDMGiPdSAnwajTM8M+G8p/+TVb/nrGPlUiwltKdPk+WcuvJTsHSfVatttC/U0hh3jm6hI7nBz8DRCfQ=="}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:32.946484 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-07324884-5860-4324-8624-c3045a62c5d6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Getting quotas for project b38fa406b760405f8d3004db272f1e52. Resources: {'key_pairs'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:36:32.951117 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-07324884-5860-4324-8624-c3045a62c5d6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Getting quotas for user 28dac3ee2d5c4ff5ba2d15b59e57d2a7 and project b38fa406b760405f8d3004db272f1e52. Resources: {'key_pairs'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:36:32.973522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-07324884-5860-4324-8624-c3045a62c5d6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048446 Aug 24 12:36:32.974423 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 263/518] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 24 12:36:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 12:36:33.000254 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a4df64fa-4c9b-4d71-9645-497309f56187 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:33.008650 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a4df64fa-4c9b-4d71-9645-497309f56187 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1675 microversion: 2.1 time: 0.156243 Aug 24 12:36:33.009221 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 256/519] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:32 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:34.032733 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-809d3df4-131b-435b-9134-1a0af91ac1a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:34.033361 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-809d3df4-131b-435b-9134-1a0af91ac1a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:34.039608 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-809d3df4-131b-435b-9134-1a0af91ac1a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:34.040118 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-809d3df4-131b-435b-9134-1a0af91ac1a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:34.040587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-809d3df4-131b-435b-9134-1a0af91ac1a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:34.041447 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-809d3df4-131b-435b-9134-1a0af91ac1a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:34.041995 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-809d3df4-131b-435b-9134-1a0af91ac1a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:34.042607 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-809d3df4-131b-435b-9134-1a0af91ac1a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:34.186028 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-809d3df4-131b-435b-9134-1a0af91ac1a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:34.194127 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-809d3df4-131b-435b-9134-1a0af91ac1a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1675 microversion: 2.1 time: 0.165695 Aug 24 12:36:34.194719 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 264/520] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:34 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:34.248359 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-87245591", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f380c7c-ae49-41e6-a0f6-8e8b66ed6334"}], "security_groups": [{"name": "tempest-securitygroup--6743942"}], "key_name": "tempest-keypair-801442472", "user_data": "}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:34.350024 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.network.neutron [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] validate_networks() for [('0f380c7c-ae49-41e6-a0f6-8e8b66ed6334', None, None, None, None, None)] {{(pid=127307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:36:34.927886 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Flavor limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:36:34.928310 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Image limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:36:34.928789 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Flavor pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:36:34.929515 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Image pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:36:34.929941 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:36:34.939267 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:34.939775 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:34.940208 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:34.940930 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:34.941383 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:34.941803 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:34.958500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Getting quotas for project b38fa406b760405f8d3004db272f1e52. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:36:34.962400 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Getting quotas for user 28dac3ee2d5c4ff5ba2d15b59e57d2a7 and project b38fa406b760405f8d3004db272f1e52. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:36:34.973208 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Going to run 1 instances... {{(pid=127307) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:36:34.975427 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:36:35.021972 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f91f7a4e-c60b-4e24-a88f-402671b24648 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.778525 Aug 24 12:36:35.022818 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 257/521] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 12:36:34 2022] POST /compute/v2.1/servers => generated 399 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 12:36:35.034524 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d07ff183-dd44-4484-8678-d23e4ee02bb6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:35.035137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d07ff183-dd44-4484-8678-d23e4ee02bb6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:35.089974 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d07ff183-dd44-4484-8678-d23e4ee02bb6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:35.097256 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d07ff183-dd44-4484-8678-d23e4ee02bb6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:35.098780 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d07ff183-dd44-4484-8678-d23e4ee02bb6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:35.099895 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d07ff183-dd44-4484-8678-d23e4ee02bb6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1279 microversion: 2.20 time: 0.069742 Aug 24 12:36:35.100447 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 265/522] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:35 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1279 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:36:35.216615 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-68ca2d37-664b-4004-a963-69f85b04b0c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:35.217228 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-68ca2d37-664b-4004-a963-69f85b04b0c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:35.225517 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-68ca2d37-664b-4004-a963-69f85b04b0c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:35.226007 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-68ca2d37-664b-4004-a963-69f85b04b0c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:35.226462 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-68ca2d37-664b-4004-a963-69f85b04b0c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:35.227140 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-68ca2d37-664b-4004-a963-69f85b04b0c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:35.227596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-68ca2d37-664b-4004-a963-69f85b04b0c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:35.228061 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-68ca2d37-664b-4004-a963-69f85b04b0c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:35.365536 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-68ca2d37-664b-4004-a963-69f85b04b0c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:35.374152 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-68ca2d37-664b-4004-a963-69f85b04b0c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1652 microversion: 2.1 time: 0.162102 Aug 24 12:36:35.374743 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 258/523] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:35 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1652 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:35.396240 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2c172909-8df6-44ed-9ab6-606f2796c2ae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:35.402853 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c172909-8df6-44ed-9ab6-606f2796c2ae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:35.403342 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c172909-8df6-44ed-9ab6-606f2796c2ae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:35.403881 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c172909-8df6-44ed-9ab6-606f2796c2ae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:35.426172 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2c172909-8df6-44ed-9ab6-606f2796c2ae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Going to try to start instance {{(pid=127308) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 12:36:35.470957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2c172909-8df6-44ed-9ab6-606f2796c2ae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "POST /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/action" status: 202 len: 0 microversion: 2.1 time: 0.078208 Aug 24 12:36:35.472130 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 266/524] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 12:36:35 2022] POST /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:36:35.481682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-39f00a36-efff-414f-aca4-7d1431c1dfd3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:35.482560 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-39f00a36-efff-414f-aca4-7d1431c1dfd3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:35.488788 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39f00a36-efff-414f-aca4-7d1431c1dfd3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:35.489487 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39f00a36-efff-414f-aca4-7d1431c1dfd3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:35.490140 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39f00a36-efff-414f-aca4-7d1431c1dfd3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:35.491022 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39f00a36-efff-414f-aca4-7d1431c1dfd3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:35.491861 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39f00a36-efff-414f-aca4-7d1431c1dfd3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:35.492347 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39f00a36-efff-414f-aca4-7d1431c1dfd3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:35.638319 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-39f00a36-efff-414f-aca4-7d1431c1dfd3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:35.645922 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-39f00a36-efff-414f-aca4-7d1431c1dfd3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1661 microversion: 2.1 time: 0.168965 Aug 24 12:36:35.646493 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 259/525] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:35 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1661 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:36.123329 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-5bec93a2-f2af-4948-85d7-290b1018d790 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:36.124893 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-5bec93a2-f2af-4948-85d7-290b1018d790 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:36.132490 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bec93a2-f2af-4948-85d7-290b1018d790 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:36.133283 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bec93a2-f2af-4948-85d7-290b1018d790 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:36.133975 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bec93a2-f2af-4948-85d7-290b1018d790 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:36.135148 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bec93a2-f2af-4948-85d7-290b1018d790 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:36.135812 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bec93a2-f2af-4948-85d7-290b1018d790 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:36.136539 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bec93a2-f2af-4948-85d7-290b1018d790 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:36.208350 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-5bec93a2-f2af-4948-85d7-290b1018d790 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:36.217142 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-5bec93a2-f2af-4948-85d7-290b1018d790 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:36.219193 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-5bec93a2-f2af-4948-85d7-290b1018d790 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:36.220503 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-5bec93a2-f2af-4948-85d7-290b1018d790 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1337 microversion: 2.20 time: 0.101803 Aug 24 12:36:36.221055 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 267/526] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:36 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1337 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:36.666444 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b5ac0a88-17ef-451d-9698-b1f9e95062ce tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:36.667066 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-b5ac0a88-17ef-451d-9698-b1f9e95062ce tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:36.673269 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b5ac0a88-17ef-451d-9698-b1f9e95062ce tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:36.674042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b5ac0a88-17ef-451d-9698-b1f9e95062ce tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:36.674489 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b5ac0a88-17ef-451d-9698-b1f9e95062ce tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:36.675188 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b5ac0a88-17ef-451d-9698-b1f9e95062ce tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:36.675675 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b5ac0a88-17ef-451d-9698-b1f9e95062ce tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:36.676104 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b5ac0a88-17ef-451d-9698-b1f9e95062ce tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:36.808815 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b5ac0a88-17ef-451d-9698-b1f9e95062ce tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:36.816712 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b5ac0a88-17ef-451d-9698-b1f9e95062ce tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1661 microversion: 2.1 time: 0.154197 Aug 24 12:36:36.817372 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 260/527] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:36 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1661 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:37.243557 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e5527474-f1c2-48e4-9043-7d8e90fb7f62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:37.244192 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e5527474-f1c2-48e4-9043-7d8e90fb7f62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:37.250998 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e5527474-f1c2-48e4-9043-7d8e90fb7f62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:37.251475 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e5527474-f1c2-48e4-9043-7d8e90fb7f62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:37.251918 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e5527474-f1c2-48e4-9043-7d8e90fb7f62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:37.252598 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e5527474-f1c2-48e4-9043-7d8e90fb7f62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:37.253042 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e5527474-f1c2-48e4-9043-7d8e90fb7f62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:37.253457 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e5527474-f1c2-48e4-9043-7d8e90fb7f62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:37.385119 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e5527474-f1c2-48e4-9043-7d8e90fb7f62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:37.393139 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e5527474-f1c2-48e4-9043-7d8e90fb7f62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:37.394611 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e5527474-f1c2-48e4-9043-7d8e90fb7f62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:37.395722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e5527474-f1c2-48e4-9043-7d8e90fb7f62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1402 microversion: 2.20 time: 0.155976 Aug 24 12:36:37.396274 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 268/528] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:37 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1402 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:37.838558 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-19aeb6eb-93ad-4589-8077-35d64faeb6c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:37.839180 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-19aeb6eb-93ad-4589-8077-35d64faeb6c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:37.845974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19aeb6eb-93ad-4589-8077-35d64faeb6c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:37.846545 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19aeb6eb-93ad-4589-8077-35d64faeb6c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:37.847135 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19aeb6eb-93ad-4589-8077-35d64faeb6c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:37.847888 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19aeb6eb-93ad-4589-8077-35d64faeb6c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:37.848475 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19aeb6eb-93ad-4589-8077-35d64faeb6c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:37.848904 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19aeb6eb-93ad-4589-8077-35d64faeb6c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:37.986147 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-19aeb6eb-93ad-4589-8077-35d64faeb6c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:37.994502 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-19aeb6eb-93ad-4589-8077-35d64faeb6c5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1665 microversion: 2.1 time: 0.159469 Aug 24 12:36:37.995075 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 261/529] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:37 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:38.419070 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-50b05bbc-426f-403f-91eb-f4c5e99854f6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:38.419674 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-50b05bbc-426f-403f-91eb-f4c5e99854f6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:38.426975 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-50b05bbc-426f-403f-91eb-f4c5e99854f6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:38.427500 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-50b05bbc-426f-403f-91eb-f4c5e99854f6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:38.427987 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-50b05bbc-426f-403f-91eb-f4c5e99854f6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:38.428762 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-50b05bbc-426f-403f-91eb-f4c5e99854f6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:38.429235 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-50b05bbc-426f-403f-91eb-f4c5e99854f6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:38.429653 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-50b05bbc-426f-403f-91eb-f4c5e99854f6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:38.560994 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-50b05bbc-426f-403f-91eb-f4c5e99854f6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:38.569336 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-50b05bbc-426f-403f-91eb-f4c5e99854f6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:38.570842 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-50b05bbc-426f-403f-91eb-f4c5e99854f6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:38.572714 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-50b05bbc-426f-403f-91eb-f4c5e99854f6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1402 microversion: 2.20 time: 0.157586 Aug 24 12:36:38.573286 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 269/530] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:38 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1402 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:38.642672 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-df407d7d-3e28-46bd-9963-17e7a212fae7 req-f5625e8a-7aa1-4152-895c-6a2c39115eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cec78743-6cd7-4df3-a22c-72acff29cf1a", "tag": "50ca3644-951e-4983-8b1f-534cdf89c8cb"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:38.652509 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-df407d7d-3e28-46bd-9963-17e7a212fae7 req-f5625e8a-7aa1-4152-895c-6a2c39115eff service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:38.652982 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-df407d7d-3e28-46bd-9963-17e7a212fae7 req-f5625e8a-7aa1-4152-895c-6a2c39115eff service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:38.653405 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-df407d7d-3e28-46bd-9963-17e7a212fae7 req-f5625e8a-7aa1-4152-895c-6a2c39115eff service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:38.664243 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-df407d7d-3e28-46bd-9963-17e7a212fae7 req-f5625e8a-7aa1-4152-895c-6a2c39115eff service nova] Creating event network-changed:50ca3644-951e-4983-8b1f-534cdf89c8cb for instance cec78743-6cd7-4df3-a22c-72acff29cf1a on hv-cinder-84890 Aug 24 12:36:38.670046 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-df407d7d-3e28-46bd-9963-17e7a212fae7 req-f5625e8a-7aa1-4152-895c-6a2c39115eff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031597 Aug 24 12:36:38.670865 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 262/531] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:36:39.594856 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2c492cde-5065-4900-974a-27fd010b084e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:39.595470 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2c492cde-5065-4900-974a-27fd010b084e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:39.601917 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c492cde-5065-4900-974a-27fd010b084e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:39.602392 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c492cde-5065-4900-974a-27fd010b084e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:39.602817 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c492cde-5065-4900-974a-27fd010b084e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:39.604600 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c492cde-5065-4900-974a-27fd010b084e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:39.605076 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c492cde-5065-4900-974a-27fd010b084e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:39.605492 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2c492cde-5065-4900-974a-27fd010b084e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:39.609520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:39.739424 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2c492cde-5065-4900-974a-27fd010b084e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:39.748989 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2c492cde-5065-4900-974a-27fd010b084e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:39.750561 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2c492cde-5065-4900-974a-27fd010b084e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:39.751687 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2c492cde-5065-4900-974a-27fd010b084e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1402 microversion: 2.20 time: 0.160666 Aug 24 12:36:39.752245 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 270/532] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:39 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1402 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:40.776113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-24b214b8-88c6-4aae-9dbe-490e8e714037 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:40.776955 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-24b214b8-88c6-4aae-9dbe-490e8e714037 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:40.783663 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-24b214b8-88c6-4aae-9dbe-490e8e714037 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.784442 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-24b214b8-88c6-4aae-9dbe-490e8e714037 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.784644 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-24b214b8-88c6-4aae-9dbe-490e8e714037 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.785307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-24b214b8-88c6-4aae-9dbe-490e8e714037 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.785764 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-24b214b8-88c6-4aae-9dbe-490e8e714037 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.786187 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-24b214b8-88c6-4aae-9dbe-490e8e714037 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.928656 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-24b214b8-88c6-4aae-9dbe-490e8e714037 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:40.938082 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-24b214b8-88c6-4aae-9dbe-490e8e714037 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:40.939659 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-24b214b8-88c6-4aae-9dbe-490e8e714037 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:40.940764 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-24b214b8-88c6-4aae-9dbe-490e8e714037 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1402 microversion: 2.20 time: 0.170124 Aug 24 12:36:40.941319 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 263/533] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:40 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1402 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:41.964770 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f012f0e9-b836-4bfd-96c8-573b98704b8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:41.965369 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f012f0e9-b836-4bfd-96c8-573b98704b8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:41.971750 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f012f0e9-b836-4bfd-96c8-573b98704b8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:41.972229 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f012f0e9-b836-4bfd-96c8-573b98704b8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:41.972658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f012f0e9-b836-4bfd-96c8-573b98704b8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:41.973338 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f012f0e9-b836-4bfd-96c8-573b98704b8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:41.973794 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f012f0e9-b836-4bfd-96c8-573b98704b8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:41.974209 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f012f0e9-b836-4bfd-96c8-573b98704b8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:42.098972 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f012f0e9-b836-4bfd-96c8-573b98704b8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:42.107792 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f012f0e9-b836-4bfd-96c8-573b98704b8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:42.109290 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f012f0e9-b836-4bfd-96c8-573b98704b8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:42.110846 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f012f0e9-b836-4bfd-96c8-573b98704b8e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1402 microversion: 2.20 time: 0.150465 Aug 24 12:36:42.111410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 271/534] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:41 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1402 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:42.906612 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-5d7218a2-a1e3-4545-b252-5c628ae396ef req-1e110575-9a20-4edd-96c6-ad86e6cd6717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec78743-6cd7-4df3-a22c-72acff29cf1a", "name": "network-vif-plugged", "status": "completed", "tag": "50ca3644-951e-4983-8b1f-534cdf89c8cb"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:42.916980 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-5d7218a2-a1e3-4545-b252-5c628ae396ef req-1e110575-9a20-4edd-96c6-ad86e6cd6717 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:42.917493 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-5d7218a2-a1e3-4545-b252-5c628ae396ef req-1e110575-9a20-4edd-96c6-ad86e6cd6717 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:42.917923 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-5d7218a2-a1e3-4545-b252-5c628ae396ef req-1e110575-9a20-4edd-96c6-ad86e6cd6717 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:42.929192 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-5d7218a2-a1e3-4545-b252-5c628ae396ef req-1e110575-9a20-4edd-96c6-ad86e6cd6717 service nova] Creating event network-vif-plugged:50ca3644-951e-4983-8b1f-534cdf89c8cb for instance cec78743-6cd7-4df3-a22c-72acff29cf1a on hv-cinder-84890 Aug 24 12:36:42.934613 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-5d7218a2-a1e3-4545-b252-5c628ae396ef req-1e110575-9a20-4edd-96c6-ad86e6cd6717 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031633 Aug 24 12:36:42.935382 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 264/535] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:43.133752 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9061791e-294e-45bb-8f10-1c16247dde4a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:43.134389 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9061791e-294e-45bb-8f10-1c16247dde4a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:43.140949 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9061791e-294e-45bb-8f10-1c16247dde4a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:43.141434 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9061791e-294e-45bb-8f10-1c16247dde4a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:43.141868 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9061791e-294e-45bb-8f10-1c16247dde4a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:43.142591 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9061791e-294e-45bb-8f10-1c16247dde4a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:43.143047 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9061791e-294e-45bb-8f10-1c16247dde4a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:43.143506 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9061791e-294e-45bb-8f10-1c16247dde4a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:43.275671 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9061791e-294e-45bb-8f10-1c16247dde4a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:43.284470 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9061791e-294e-45bb-8f10-1c16247dde4a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:43.285970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9061791e-294e-45bb-8f10-1c16247dde4a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:43.287059 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9061791e-294e-45bb-8f10-1c16247dde4a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1402 microversion: 2.20 time: 0.157230 Aug 24 12:36:43.287632 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 272/536] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:43 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1402 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:44.310579 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-39545c3c-6c49-48e0-b2a6-3947bfcbd791 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:44.311275 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-39545c3c-6c49-48e0-b2a6-3947bfcbd791 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:44.317437 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39545c3c-6c49-48e0-b2a6-3947bfcbd791 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:44.317920 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39545c3c-6c49-48e0-b2a6-3947bfcbd791 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:44.318352 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39545c3c-6c49-48e0-b2a6-3947bfcbd791 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:44.319034 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39545c3c-6c49-48e0-b2a6-3947bfcbd791 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:44.319489 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39545c3c-6c49-48e0-b2a6-3947bfcbd791 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:44.319939 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-39545c3c-6c49-48e0-b2a6-3947bfcbd791 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:44.450341 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-39545c3c-6c49-48e0-b2a6-3947bfcbd791 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:44.458718 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-39545c3c-6c49-48e0-b2a6-3947bfcbd791 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:44.460248 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-39545c3c-6c49-48e0-b2a6-3947bfcbd791 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:44.461371 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-39545c3c-6c49-48e0-b2a6-3947bfcbd791 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1402 microversion: 2.20 time: 0.155489 Aug 24 12:36:44.461936 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 265/537] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:44 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1402 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:45.486436 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4716dfd1-1390-4888-ba6c-4f7ef6a011a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:45.487049 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4716dfd1-1390-4888-ba6c-4f7ef6a011a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:45.489410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=6 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:45.495231 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4716dfd1-1390-4888-ba6c-4f7ef6a011a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:45.496297 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4716dfd1-1390-4888-ba6c-4f7ef6a011a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:45.496731 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4716dfd1-1390-4888-ba6c-4f7ef6a011a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:45.497431 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4716dfd1-1390-4888-ba6c-4f7ef6a011a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:45.497883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4716dfd1-1390-4888-ba6c-4f7ef6a011a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:45.498309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4716dfd1-1390-4888-ba6c-4f7ef6a011a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:45.630070 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4716dfd1-1390-4888-ba6c-4f7ef6a011a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:45.638057 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4716dfd1-1390-4888-ba6c-4f7ef6a011a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:45.639531 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4716dfd1-1390-4888-ba6c-4f7ef6a011a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:45.640689 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4716dfd1-1390-4888-ba6c-4f7ef6a011a0 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1593 microversion: 2.20 time: 0.159071 Aug 24 12:36:45.641241 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 273/538] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:45 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1593 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:45.663111 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3c36e681-e0fb-4f8a-a7d2-96e8cbd49a05 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:45.663648 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3c36e681-e0fb-4f8a-a7d2-96e8cbd49a05 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:45.665593 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:45.666448 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=6 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:45.673031 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c36e681-e0fb-4f8a-a7d2-96e8cbd49a05 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:45.673518 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c36e681-e0fb-4f8a-a7d2-96e8cbd49a05 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:45.673957 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c36e681-e0fb-4f8a-a7d2-96e8cbd49a05 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:45.674648 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c36e681-e0fb-4f8a-a7d2-96e8cbd49a05 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:45.675103 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c36e681-e0fb-4f8a-a7d2-96e8cbd49a05 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:45.675528 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3c36e681-e0fb-4f8a-a7d2-96e8cbd49a05 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:45.753207 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3c36e681-e0fb-4f8a-a7d2-96e8cbd49a05 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093876 Aug 24 12:36:45.753827 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 266/539] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 24 12:36:45 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:36:46.671897 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-54ee049b-9a67-432d-abb8-e46386632734 req-9dd65a1e-5bee-4679-831d-e40c0c37e258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cec78743-6cd7-4df3-a22c-72acff29cf1a", "tag": "50ca3644-951e-4983-8b1f-534cdf89c8cb"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:46.681969 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-54ee049b-9a67-432d-abb8-e46386632734 req-9dd65a1e-5bee-4679-831d-e40c0c37e258 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:46.682979 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-54ee049b-9a67-432d-abb8-e46386632734 req-9dd65a1e-5bee-4679-831d-e40c0c37e258 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:46.683410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-54ee049b-9a67-432d-abb8-e46386632734 req-9dd65a1e-5bee-4679-831d-e40c0c37e258 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:46.694378 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-54ee049b-9a67-432d-abb8-e46386632734 req-9dd65a1e-5bee-4679-831d-e40c0c37e258 service nova] Creating event network-changed:50ca3644-951e-4983-8b1f-534cdf89c8cb for instance cec78743-6cd7-4df3-a22c-72acff29cf1a on hv-cinder-84890 Aug 24 12:36:46.700140 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-54ee049b-9a67-432d-abb8-e46386632734 req-9dd65a1e-5bee-4679-831d-e40c0c37e258 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032354 Aug 24 12:36:46.700725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 274/540] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:59.541308 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:59.542271 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=89 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:59.547117 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8c20df62-4a84-432c-88c6-f07b2f7d0aad tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:59.547650 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8c20df62-4a84-432c-88c6-f07b2f7d0aad tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:59.554571 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c20df62-4a84-432c-88c6-f07b2f7d0aad tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:59.555055 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c20df62-4a84-432c-88c6-f07b2f7d0aad tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:59.555485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c20df62-4a84-432c-88c6-f07b2f7d0aad tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:59.556202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c20df62-4a84-432c-88c6-f07b2f7d0aad tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:59.556654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c20df62-4a84-432c-88c6-f07b2f7d0aad tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:59.557080 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c20df62-4a84-432c-88c6-f07b2f7d0aad tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:59.581098 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8c20df62-4a84-432c-88c6-f07b2f7d0aad tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/ips" status: 200 len: 149 microversion: 2.1 time: 0.041190 Aug 24 12:36:59.581654 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 267/541] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 12:36:59 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:00.910045 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:00.910786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=24 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:00.914954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c20321dc-4a48-42c4-9a04-600a9b45c3f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc0051eb-1597-4e73-882e-2d7affb92e8d"}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:00.917367 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c20321dc-4a48-42c4-9a04-600a9b45c3f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:00.924939 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c20321dc-4a48-42c4-9a04-600a9b45c3f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:00.925419 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c20321dc-4a48-42c4-9a04-600a9b45c3f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:00.925848 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c20321dc-4a48-42c4-9a04-600a9b45c3f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:00.926525 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c20321dc-4a48-42c4-9a04-600a9b45c3f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:00.926973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c20321dc-4a48-42c4-9a04-600a9b45c3f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:00.927389 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c20321dc-4a48-42c4-9a04-600a9b45c3f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:01.169842 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c20321dc-4a48-42c4-9a04-600a9b45c3f9 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "POST /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260795 Aug 24 12:37:01.170430 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 275/542] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 12:37:00 2022] POST /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:07.288957 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-951a7f1c-6366-4bcd-917c-6a8059701624 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:07.289519 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-951a7f1c-6366-4bcd-917c-6a8059701624 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:07.297166 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-951a7f1c-6366-4bcd-917c-6a8059701624 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:07.297661 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-951a7f1c-6366-4bcd-917c-6a8059701624 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:07.298097 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-951a7f1c-6366-4bcd-917c-6a8059701624 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:07.298805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-951a7f1c-6366-4bcd-917c-6a8059701624 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:07.299258 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-951a7f1c-6366-4bcd-917c-6a8059701624 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:07.299699 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-951a7f1c-6366-4bcd-917c-6a8059701624 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:07.382113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.objects.instance [None req-951a7f1c-6366-4bcd-917c-6a8059701624 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lazy-loading 'services' on Instance uuid 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 {{(pid=127307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:37:07.452772 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-951a7f1c-6366-4bcd-917c-6a8059701624 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "DELETE /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/os-volume_attachments/672e6b28-87a7-4ef0-bdaa-93802933fe21" status: 202 len: 0 microversion: 2.1 time: 0.168659 Aug 24 12:37:07.453352 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 268/543] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 12:37:07 2022] DELETE /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/os-volume_attachments/672e6b28-87a7-4ef0-bdaa-93802933fe21 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:37:07.462236 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-796760ff-012c-4736-a56e-3d6699360ef4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:07.464711 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-796760ff-012c-4736-a56e-3d6699360ef4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:07.471438 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-796760ff-012c-4736-a56e-3d6699360ef4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:07.471961 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-796760ff-012c-4736-a56e-3d6699360ef4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:07.472385 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-796760ff-012c-4736-a56e-3d6699360ef4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:07.473059 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-796760ff-012c-4736-a56e-3d6699360ef4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:07.473501 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-796760ff-012c-4736-a56e-3d6699360ef4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:07.473917 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-796760ff-012c-4736-a56e-3d6699360ef4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:07.504861 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-796760ff-012c-4736-a56e-3d6699360ef4 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046829 Aug 24 12:37:07.505328 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 276/544] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:07 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:08.517955 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9b47237b-bb7d-42ed-a91d-19a827a3f793 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:08.520322 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-9b47237b-bb7d-42ed-a91d-19a827a3f793 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:08.526463 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b47237b-bb7d-42ed-a91d-19a827a3f793 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.526946 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b47237b-bb7d-42ed-a91d-19a827a3f793 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.527388 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b47237b-bb7d-42ed-a91d-19a827a3f793 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.528109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b47237b-bb7d-42ed-a91d-19a827a3f793 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.528564 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b47237b-bb7d-42ed-a91d-19a827a3f793 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.528989 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b47237b-bb7d-42ed-a91d-19a827a3f793 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.557642 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9b47237b-bb7d-42ed-a91d-19a827a3f793 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044513 Aug 24 12:37:08.558190 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 269/545] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:08 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:37:08.640360 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-137d4759-e86c-4ec2-99de-d99b5a9d1e0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:08.640865 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-137d4759-e86c-4ec2-99de-d99b5a9d1e0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:08.647410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-137d4759-e86c-4ec2-99de-d99b5a9d1e0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.647925 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-137d4759-e86c-4ec2-99de-d99b5a9d1e0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.648362 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-137d4759-e86c-4ec2-99de-d99b5a9d1e0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.649058 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-137d4759-e86c-4ec2-99de-d99b5a9d1e0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.649539 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-137d4759-e86c-4ec2-99de-d99b5a9d1e0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.649960 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-137d4759-e86c-4ec2-99de-d99b5a9d1e0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.675642 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-137d4759-e86c-4ec2-99de-d99b5a9d1e0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Going to try to terminate instance {{(pid=127308) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:37:08.714855 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9680d845-4c82-4cfe-aab1-b7330ee83cc2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc0051eb-1597-4e73-882e-2d7affb92e8d"}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:08.717321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-9680d845-4c82-4cfe-aab1-b7330ee83cc2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:08.723492 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9680d845-4c82-4cfe-aab1-b7330ee83cc2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.724011 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9680d845-4c82-4cfe-aab1-b7330ee83cc2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.724478 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9680d845-4c82-4cfe-aab1-b7330ee83cc2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.725177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9680d845-4c82-4cfe-aab1-b7330ee83cc2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.725631 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9680d845-4c82-4cfe-aab1-b7330ee83cc2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.726398 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9680d845-4c82-4cfe-aab1-b7330ee83cc2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.753536 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-137d4759-e86c-4ec2-99de-d99b5a9d1e0c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "DELETE /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 204 len: 0 microversion: 2.1 time: 0.117164 Aug 24 12:37:08.754133 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 277/546] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:37:08 2022] DELETE /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:37:08.762394 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2a70b11d-394b-4654-8fe9-360018f308a0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:08.763190 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2a70b11d-394b-4654-8fe9-360018f308a0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:08.769163 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2a70b11d-394b-4654-8fe9-360018f308a0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.769598 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2a70b11d-394b-4654-8fe9-360018f308a0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.770032 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2a70b11d-394b-4654-8fe9-360018f308a0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.770736 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2a70b11d-394b-4654-8fe9-360018f308a0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.771187 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2a70b11d-394b-4654-8fe9-360018f308a0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.771612 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2a70b11d-394b-4654-8fe9-360018f308a0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.811253 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-9680d845-4c82-4cfe-aab1-b7330ee83cc2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] HTTP exception thrown: Invalid volume: volume cc0051eb-1597-4e73-882e-2d7affb92e8d is already attached to instances: 871692ae-90bf-465a-ba88-24cfd077e5de Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9680d845-4c82-4cfe-aab1-b7330ee83cc2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Request method failure captured: Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: POST /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments HTTP/1.1 Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 74 Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhptX0YqROqNx9UwMblZH009WKCG7BL_aq4XeZf5ruCxnINLTbZjkM1uY9mAwjGHDX4uNPq1GuTB3ldLiiOiheC0oM9d1taj1Dr9v5q40AFD6MPcStG0igxeq4w-WcOLdJxPRTIIrqfH6xB1-wHZLVNdeJomT9Bmh01X6Epb9BGxpj8 Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:37:08.813036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:37:08.817042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:37:08.817042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:37:08.817042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:37:08.817042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:37:08.817042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:37:08.817042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:37:08.817042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:37:08.817042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 9aa753d1e2c4430498d5b28f0304952f Aug 24 12:37:08.817042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:37:08.817042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Aug 24 12:37:08.817042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {"volumeAttachment": {"volumeId": "cc0051eb-1597-4e73-882e-2d7affb92e8d"}} Aug 24 12:37:08.817042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Invalid volume: volume cc0051eb-1597-4e73-882e-2d7affb92e8d is already attached to instances: 871692ae-90bf-465a-ba88-24cfd077e5de Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'server_id': '871692ae-90bf-465a-ba88-24cfd077e5de', 'body': {'volumeAttachment': {'volumeId': 'cc0051eb-1597-4e73-882e-2d7affb92e8d'}}} Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cc0051eb-1597-4e73-882e-2d7affb92e8d is already attached to instances: 871692ae-90bf-465a-ba88-24cfd077e5de Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:08.818162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cc0051eb-1597-4e73-882e-2d7affb92e8d is already attached to instances: 871692ae-90bf-465a-ba88-24cfd077e5de Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:08.819671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:08.821239 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:08.821239 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:37:08.821239 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:37:08.821239 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cc0051eb-1597-4e73-882e-2d7affb92e8d is already attached to instances: 871692ae-90bf-465a-ba88-24cfd077e5de Aug 24 12:37:08.821239 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:08.821239 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9680d845-4c82-4cfe-aab1-b7330ee83cc2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Returning 400 to user: Invalid volume: volume cc0051eb-1597-4e73-882e-2d7affb92e8d is already attached to instances: 871692ae-90bf-465a-ba88-24cfd077e5de {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:37:08.821239 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9680d845-4c82-4cfe-aab1-b7330ee83cc2 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "POST /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103945 Aug 24 12:37:08.821239 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 270/547] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 12:37:08 2022] POST /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:37:08.881620 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5fe5fbf9-8516-4136-a97d-9f6653dd39cb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:08.882391 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5fe5fbf9-8516-4136-a97d-9f6653dd39cb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:08.889100 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5fe5fbf9-8516-4136-a97d-9f6653dd39cb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.889589 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5fe5fbf9-8516-4136-a97d-9f6653dd39cb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.890024 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5fe5fbf9-8516-4136-a97d-9f6653dd39cb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.890922 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5fe5fbf9-8516-4136-a97d-9f6653dd39cb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.891383 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5fe5fbf9-8516-4136-a97d-9f6653dd39cb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.891839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5fe5fbf9-8516-4136-a97d-9f6653dd39cb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.913058 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2a70b11d-394b-4654-8fe9-360018f308a0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:08.920835 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2a70b11d-394b-4654-8fe9-360018f308a0 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1688 microversion: 2.1 time: 0.162439 Aug 24 12:37:08.921401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 278/548] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:08 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:08.971581 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.objects.instance [None req-5fe5fbf9-8516-4136-a97d-9f6653dd39cb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lazy-loading 'services' on Instance uuid 871692ae-90bf-465a-ba88-24cfd077e5de {{(pid=127307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:37:09.041543 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5fe5fbf9-8516-4136-a97d-9f6653dd39cb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "DELETE /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments/cc0051eb-1597-4e73-882e-2d7affb92e8d" status: 202 len: 0 microversion: 2.1 time: 0.163660 Aug 24 12:37:09.042114 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 271/549] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 12:37:08 2022] DELETE /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments/cc0051eb-1597-4e73-882e-2d7affb92e8d => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:37:09.050833 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a90a46d9-b9e2-4bad-bd84-8528dd7c2440 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:09.053015 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-a90a46d9-b9e2-4bad-bd84-8528dd7c2440 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:09.058926 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a90a46d9-b9e2-4bad-bd84-8528dd7c2440 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:09.059998 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a90a46d9-b9e2-4bad-bd84-8528dd7c2440 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:09.060437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a90a46d9-b9e2-4bad-bd84-8528dd7c2440 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:09.061120 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a90a46d9-b9e2-4bad-bd84-8528dd7c2440 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:09.061598 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a90a46d9-b9e2-4bad-bd84-8528dd7c2440 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:09.062018 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a90a46d9-b9e2-4bad-bd84-8528dd7c2440 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:09.092629 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a90a46d9-b9e2-4bad-bd84-8528dd7c2440 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Aug 24 12:37:09.093181 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 279/550] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:09 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:09.942648 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6e478509-f638-4f8e-be41-7b22c24b49e1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:09.943351 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-6e478509-f638-4f8e-be41-7b22c24b49e1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:09.949552 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e478509-f638-4f8e-be41-7b22c24b49e1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:09.950800 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e478509-f638-4f8e-be41-7b22c24b49e1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:09.951496 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e478509-f638-4f8e-be41-7b22c24b49e1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:09.952209 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e478509-f638-4f8e-be41-7b22c24b49e1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:09.952661 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e478509-f638-4f8e-be41-7b22c24b49e1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:09.953082 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e478509-f638-4f8e-be41-7b22c24b49e1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:10.080511 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6e478509-f638-4f8e-be41-7b22c24b49e1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:10.088051 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-6e478509-f638-4f8e-be41-7b22c24b49e1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1688 microversion: 2.1 time: 0.150188 Aug 24 12:37:10.088602 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 272/551] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:09 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:10.104832 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-dfb47037-a90d-4891-856d-6bd399c0241d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:10.107477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-dfb47037-a90d-4891-856d-6bd399c0241d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:10.113833 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-dfb47037-a90d-4891-856d-6bd399c0241d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:10.114249 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-dfb47037-a90d-4891-856d-6bd399c0241d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:10.114681 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-dfb47037-a90d-4891-856d-6bd399c0241d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:10.115364 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-dfb47037-a90d-4891-856d-6bd399c0241d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:10.115860 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-dfb47037-a90d-4891-856d-6bd399c0241d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:10.116286 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-dfb47037-a90d-4891-856d-6bd399c0241d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:10.145212 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-dfb47037-a90d-4891-856d-6bd399c0241d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044144 Aug 24 12:37:10.145739 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 280/552] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:10 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:11.108954 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3ce30d93-8b38-456d-a8be-de0971db6a7c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:11.109559 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3ce30d93-8b38-456d-a8be-de0971db6a7c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:11.116016 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ce30d93-8b38-456d-a8be-de0971db6a7c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.116501 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ce30d93-8b38-456d-a8be-de0971db6a7c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.116934 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ce30d93-8b38-456d-a8be-de0971db6a7c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.117621 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ce30d93-8b38-456d-a8be-de0971db6a7c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.118072 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ce30d93-8b38-456d-a8be-de0971db6a7c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.118496 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3ce30d93-8b38-456d-a8be-de0971db6a7c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.158117 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-17d0cb37-e360-4351-9e77-37c661b0fe61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:11.160175 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-17d0cb37-e360-4351-9e77-37c661b0fe61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:11.166560 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-17d0cb37-e360-4351-9e77-37c661b0fe61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.167037 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-17d0cb37-e360-4351-9e77-37c661b0fe61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.167459 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-17d0cb37-e360-4351-9e77-37c661b0fe61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.168172 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-17d0cb37-e360-4351-9e77-37c661b0fe61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.169318 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-17d0cb37-e360-4351-9e77-37c661b0fe61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.169781 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-17d0cb37-e360-4351-9e77-37c661b0fe61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.198717 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-17d0cb37-e360-4351-9e77-37c661b0fe61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 Aug 24 12:37:11.199896 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 281/553] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:11 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:37:11.260065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-3ce30d93-8b38-456d-a8be-de0971db6a7c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:11.268544 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3ce30d93-8b38-456d-a8be-de0971db6a7c tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1688 microversion: 2.1 time: 0.163674 Aug 24 12:37:11.269142 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 273/554] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:11 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:12.210584 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b1766605-8593-4ba0-a6c4-a0c3c47881a3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:12.212698 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b1766605-8593-4ba0-a6c4-a0c3c47881a3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:12.219178 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b1766605-8593-4ba0-a6c4-a0c3c47881a3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:12.219697 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b1766605-8593-4ba0-a6c4-a0c3c47881a3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:12.220137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b1766605-8593-4ba0-a6c4-a0c3c47881a3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:12.220831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b1766605-8593-4ba0-a6c4-a0c3c47881a3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:12.221281 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b1766605-8593-4ba0-a6c4-a0c3c47881a3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:12.221736 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b1766605-8593-4ba0-a6c4-a0c3c47881a3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:12.253070 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b1766605-8593-4ba0-a6c4-a0c3c47881a3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046439 Aug 24 12:37:12.253644 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 282/555] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:12 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:12.290121 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-188da683-9005-4e1f-ae2f-c912eb86549d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:12.290734 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-188da683-9005-4e1f-ae2f-c912eb86549d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:12.297779 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-188da683-9005-4e1f-ae2f-c912eb86549d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:12.298267 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-188da683-9005-4e1f-ae2f-c912eb86549d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:12.298703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-188da683-9005-4e1f-ae2f-c912eb86549d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:12.299398 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-188da683-9005-4e1f-ae2f-c912eb86549d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:12.299881 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-188da683-9005-4e1f-ae2f-c912eb86549d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:12.300306 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-188da683-9005-4e1f-ae2f-c912eb86549d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:12.428109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-188da683-9005-4e1f-ae2f-c912eb86549d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:12.436388 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-188da683-9005-4e1f-ae2f-c912eb86549d tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1688 microversion: 2.1 time: 0.150277 Aug 24 12:37:12.436955 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 274/556] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:12 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:13.265230 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e090abd1-fa03-438a-b254-c25223e5e2a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:13.267393 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e090abd1-fa03-438a-b254-c25223e5e2a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:13.274350 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e090abd1-fa03-438a-b254-c25223e5e2a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.274832 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e090abd1-fa03-438a-b254-c25223e5e2a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.275267 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e090abd1-fa03-438a-b254-c25223e5e2a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.275982 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e090abd1-fa03-438a-b254-c25223e5e2a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.276436 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e090abd1-fa03-438a-b254-c25223e5e2a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.276852 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e090abd1-fa03-438a-b254-c25223e5e2a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.306279 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e090abd1-fa03-438a-b254-c25223e5e2a6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045506 Aug 24 12:37:13.306845 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 283/557] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:13 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:37:13.369712 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-64b23cbf-06cb-4cfc-8e8a-23ef02952a98 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:13.370259 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-64b23cbf-06cb-4cfc-8e8a-23ef02952a98 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:13.377308 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-64b23cbf-06cb-4cfc-8e8a-23ef02952a98 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.377800 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-64b23cbf-06cb-4cfc-8e8a-23ef02952a98 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.378263 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-64b23cbf-06cb-4cfc-8e8a-23ef02952a98 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.378948 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-64b23cbf-06cb-4cfc-8e8a-23ef02952a98 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.379482 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-64b23cbf-06cb-4cfc-8e8a-23ef02952a98 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.379983 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-64b23cbf-06cb-4cfc-8e8a-23ef02952a98 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.405962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-64b23cbf-06cb-4cfc-8e8a-23ef02952a98 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Going to try to terminate instance {{(pid=127307) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:37:13.459063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-271ff460-64d9-4561-b267-3b5c55806f00 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:13.459778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-271ff460-64d9-4561-b267-3b5c55806f00 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:13.466281 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-271ff460-64d9-4561-b267-3b5c55806f00 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.468462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-271ff460-64d9-4561-b267-3b5c55806f00 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.469096 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-271ff460-64d9-4561-b267-3b5c55806f00 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.470351 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-271ff460-64d9-4561-b267-3b5c55806f00 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.471293 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-271ff460-64d9-4561-b267-3b5c55806f00 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.471923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-271ff460-64d9-4561-b267-3b5c55806f00 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.487313 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-64b23cbf-06cb-4cfc-8e8a-23ef02952a98 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "DELETE /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 204 len: 0 microversion: 2.1 time: 0.121105 Aug 24 12:37:13.491954 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 275/558] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:37:13 2022] DELETE /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:37:13.499937 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-753af38f-2187-4467-9648-2a24cddedbfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:13.500650 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-753af38f-2187-4467-9648-2a24cddedbfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:13.507130 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-753af38f-2187-4467-9648-2a24cddedbfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.507676 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-753af38f-2187-4467-9648-2a24cddedbfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.508074 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-753af38f-2187-4467-9648-2a24cddedbfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.508789 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-753af38f-2187-4467-9648-2a24cddedbfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.509247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-753af38f-2187-4467-9648-2a24cddedbfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.509676 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-753af38f-2187-4467-9648-2a24cddedbfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.565054 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-271ff460-64d9-4561-b267-3b5c55806f00 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:13.574940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-271ff460-64d9-4561-b267-3b5c55806f00 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1621 microversion: 2.1 time: 0.121045 Aug 24 12:37:13.575673 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 284/559] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:13 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1621 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:37:13.662685 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-753af38f-2187-4467-9648-2a24cddedbfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:13.671324 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-753af38f-2187-4467-9648-2a24cddedbfa tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 200 len: 1681 microversion: 2.1 time: 0.177063 Aug 24 12:37:13.672041 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 276/560] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:13 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:13.786641 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-623d5b0a-da73-4f3d-aaaa-9fb07b0b6d95 req-98d08357-355d-4252-a7b8-3fd2ecdea585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06fdcfd7-6650-4fe4-8c3a-746ea58f0409", "name": "network-vif-deleted", "tag": "93921963-7c18-4787-bce0-01c4d4b2201a"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:13.796648 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-623d5b0a-da73-4f3d-aaaa-9fb07b0b6d95 req-98d08357-355d-4252-a7b8-3fd2ecdea585 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.797130 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-623d5b0a-da73-4f3d-aaaa-9fb07b0b6d95 req-98d08357-355d-4252-a7b8-3fd2ecdea585 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.797557 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-623d5b0a-da73-4f3d-aaaa-9fb07b0b6d95 req-98d08357-355d-4252-a7b8-3fd2ecdea585 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.810768 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-623d5b0a-da73-4f3d-aaaa-9fb07b0b6d95 req-98d08357-355d-4252-a7b8-3fd2ecdea585 service nova] Creating event network-vif-deleted:93921963-7c18-4787-bce0-01c4d4b2201a for instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 on hv-cinder-84890 Aug 24 12:37:13.815992 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-623d5b0a-da73-4f3d-aaaa-9fb07b0b6d95 req-98d08357-355d-4252-a7b8-3fd2ecdea585 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033049 Aug 24 12:37:13.816661 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 285/561] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:14.597372 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e1e3a294-f204-41f4-ab58-c73d71733253 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:14.597977 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e1e3a294-f204-41f4-ab58-c73d71733253 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:14.604553 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e1e3a294-f204-41f4-ab58-c73d71733253 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:14.605046 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e1e3a294-f204-41f4-ab58-c73d71733253 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:14.605473 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e1e3a294-f204-41f4-ab58-c73d71733253 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:14.606838 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e1e3a294-f204-41f4-ab58-c73d71733253 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:14.607578 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e1e3a294-f204-41f4-ab58-c73d71733253 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:14.608033 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e1e3a294-f204-41f4-ab58-c73d71733253 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:14.672984 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e1e3a294-f204-41f4-ab58-c73d71733253 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:14.683062 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e1e3a294-f204-41f4-ab58-c73d71733253 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 200 len: 1621 microversion: 2.1 time: 0.089515 Aug 24 12:37:14.684113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 277/562] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:14 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 1621 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:14.694040 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-fceec901-5d82-4368-80b4-36f6c98c8b0d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:14.695497 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-fceec901-5d82-4368-80b4-36f6c98c8b0d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:14.702760 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fceec901-5d82-4368-80b4-36f6c98c8b0d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:14.703282 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fceec901-5d82-4368-80b4-36f6c98c8b0d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:14.703755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fceec901-5d82-4368-80b4-36f6c98c8b0d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:14.704462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fceec901-5d82-4368-80b4-36f6c98c8b0d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:14.705074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fceec901-5d82-4368-80b4-36f6c98c8b0d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:14.705497 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fceec901-5d82-4368-80b4-36f6c98c8b0d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:14.838806 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-fceec901-5d82-4368-80b4-36f6c98c8b0d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:14.847609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-fceec901-5d82-4368-80b4-36f6c98c8b0d tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 200 len: 1681 microversion: 2.1 time: 0.158106 Aug 24 12:37:14.848219 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 286/563] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:14 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:15.704354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-989f2cf3-dba3-49fe-9484-67c43561b3ac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:15.705027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-989f2cf3-dba3-49fe-9484-67c43561b3ac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: 06fdcfd7-6650-4fe4-8c3a-746ea58f0409] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:15.711425 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-989f2cf3-dba3-49fe-9484-67c43561b3ac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:15.712020 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-989f2cf3-dba3-49fe-9484-67c43561b3ac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:15.712533 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-989f2cf3-dba3-49fe-9484-67c43561b3ac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:15.713317 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-989f2cf3-dba3-49fe-9484-67c43561b3ac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:15.713846 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-989f2cf3-dba3-49fe-9484-67c43561b3ac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:15.714341 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-989f2cf3-dba3-49fe-9484-67c43561b3ac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:15.728308 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-989f2cf3-dba3-49fe-9484-67c43561b3ac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] HTTP exception thrown: Instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 could not be found. Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-989f2cf3-dba3-49fe-9484-67c43561b3ac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Request method failure captured: Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 HTTP/1.1 Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhptNH4mn2TVQcU78gzQc_MEi0EjKa375myyVyDI0kkHg9_so0vJnb2xQ2TdCUf0V4s8LQu4JeSt7iwuhXjPBZKJOkVhmKBO25mKo4XuZDYED7arR8J9UwMqw0S3d9pXZhfromF_FuF00GG74qKZE1M9iai6jJhDaaYLQDZCCnQB9j8 Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: 9afa0216c9e140bb82f56f14ccfb7bb6 Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1748371241 Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:37:15.729987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:37:15.732537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:37:15.732537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1748371241 Aug 24 12:37:15.732537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: 9afa0216c9e140bb82f56f14ccfb7bb6 Aug 24 12:37:15.732537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1748371241 Aug 24 12:37:15.732537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-ServerRescueNegativeTestJSON-1748371241-project Aug 24 12:37:15.732537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:37:15.732537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:37:15.732537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 9138ac21bbdb4577a7f43b5ab471d572 Aug 24 12:37:15.732537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1748371241-project Aug 24 12:37:15.732537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:37:15.732537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 could not be found. Aug 24 12:37:15.732537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': '06fdcfd7-6650-4fe4-8c3a-746ea58f0409'} Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 could not be found. Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:37:15.733320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 could not be found. Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 could not be found. Aug 24 12:37:15.734547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:15.735665 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-989f2cf3-dba3-49fe-9484-67c43561b3ac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Returning 404 to user: Instance 06fdcfd7-6650-4fe4-8c3a-746ea58f0409 could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:37:15.735665 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-989f2cf3-dba3-49fe-9484-67c43561b3ac tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409" status: 404 len: 111 microversion: 2.1 time: 0.031892 Aug 24 12:37:15.735665 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 278/564] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:15 2022] GET /compute/v2.1/servers/06fdcfd7-6650-4fe4-8c3a-746ea58f0409 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:37:15.740879 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-54f2b101-2bf6-4908-8a27-2ff7b6de6937 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '.version_select at 0x7f4696b4f550>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:15.759485 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-54f2b101-2bf6-4908-8a27-2ff7b6de6937 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449660260" status: 202 len: 0 microversion: 2.1 time: 0.022316 Aug 24 12:37:15.760295 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 287/565] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 24 12:37:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449660260 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:37:15.870305 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c10d6b28-a245-47d3-b688-9c67e7da06af tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:15.870927 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c10d6b28-a245-47d3-b688-9c67e7da06af tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:15.886528 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c10d6b28-a245-47d3-b688-9c67e7da06af tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:15.887980 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c10d6b28-a245-47d3-b688-9c67e7da06af tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:15.888873 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c10d6b28-a245-47d3-b688-9c67e7da06af tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:15.889542 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c10d6b28-a245-47d3-b688-9c67e7da06af tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:15.890447 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c10d6b28-a245-47d3-b688-9c67e7da06af tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:15.890874 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c10d6b28-a245-47d3-b688-9c67e7da06af tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:16.025457 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c10d6b28-a245-47d3-b688-9c67e7da06af tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:16.033909 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c10d6b28-a245-47d3-b688-9c67e7da06af tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 200 len: 1613 microversion: 2.1 time: 0.167595 Aug 24 12:37:16.034723 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 279/566] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:15 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 1613 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:16.230538 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-fe138ca9-6eb6-4fa4-978a-d64294995a66 req-da57b7b8-02a7-4d77-9893-e5e08dd09a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871692ae-90bf-465a-ba88-24cfd077e5de", "name": "network-vif-deleted", "tag": "7e0ebfc0-7898-40d1-8443-1a6da286d30e"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:16.250990 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-fe138ca9-6eb6-4fa4-978a-d64294995a66 req-da57b7b8-02a7-4d77-9893-e5e08dd09a28 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:16.252201 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-fe138ca9-6eb6-4fa4-978a-d64294995a66 req-da57b7b8-02a7-4d77-9893-e5e08dd09a28 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:16.252648 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-fe138ca9-6eb6-4fa4-978a-d64294995a66 req-da57b7b8-02a7-4d77-9893-e5e08dd09a28 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:16.266592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-fe138ca9-6eb6-4fa4-978a-d64294995a66 req-da57b7b8-02a7-4d77-9893-e5e08dd09a28 service nova] Creating event network-vif-deleted:7e0ebfc0-7898-40d1-8443-1a6da286d30e for instance 871692ae-90bf-465a-ba88-24cfd077e5de on hv-cinder-84890 Aug 24 12:37:16.274016 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-fe138ca9-6eb6-4fa4-978a-d64294995a66 req-da57b7b8-02a7-4d77-9893-e5e08dd09a28 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046382 Aug 24 12:37:16.275247 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 288/567] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:17.055729 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0bf835d4-e87d-4635-9e23-99694053a706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:17.056347 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0bf835d4-e87d-4635-9e23-99694053a706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:17.064006 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0bf835d4-e87d-4635-9e23-99694053a706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:17.064493 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0bf835d4-e87d-4635-9e23-99694053a706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:17.065126 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0bf835d4-e87d-4635-9e23-99694053a706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:17.065872 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0bf835d4-e87d-4635-9e23-99694053a706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:17.066265 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0bf835d4-e87d-4635-9e23-99694053a706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:17.066687 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0bf835d4-e87d-4635-9e23-99694053a706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:17.081145 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-0bf835d4-e87d-4635-9e23-99694053a706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] HTTP exception thrown: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0bf835d4-e87d-4635-9e23-99694053a706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Request method failure captured: Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de HTTP/1.1 Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhptX0YqROqNx9UwMblZH009WKCG7BL_aq4XeZf5ruCxnINLTbZjkM1uY9mAwjGHDX4uNPq1GuTB3ldLiiOiheC0oM9d1taj1Dr9v5q40AFD6MPcStG0igxeq4w-WcOLdJxPRTIIrqfH6xB1-wHZLVNdeJomT9Bmh01X6Epb9BGxpj8 Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:37:17.082725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:37:17.084378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:37:17.084378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:37:17.084378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:37:17.084378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:37:17.084378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:37:17.084378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:37:17.084378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:37:17.084378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 9aa753d1e2c4430498d5b28f0304952f Aug 24 12:37:17.084378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:37:17.084378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:37:17.084378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. Aug 24 12:37:17.084378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': '871692ae-90bf-465a-ba88-24cfd077e5de'} Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:37:17.085246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. Aug 24 12:37:17.086805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:17.088331 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0bf835d4-e87d-4635-9e23-99694053a706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Returning 404 to user: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:37:17.088331 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0bf835d4-e87d-4635-9e23-99694053a706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 404 len: 111 microversion: 2.1 time: 0.032341 Aug 24 12:37:17.088331 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 280/568] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:17 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:37:17.094470 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d8958e6f-1b26-4a04-a92c-8d6aac3f9234 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '.version_select at 0x7f4696b6f8b0>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:17.114033 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d8958e6f-1b26-4a04-a92c-8d6aac3f9234 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1903419479" status: 202 len: 0 microversion: 2.1 time: 0.024388 Aug 24 12:37:17.114618 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 289/569] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 24 12:37:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1903419479 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:37:17.775682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9a72056b-5998-4581-8184-7cdb944e7fd3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Action: 'create', calling method: .version_select at 0x7f46973e5700>, body: {"keypair": {"name": "tempest-keypair-1132293919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuhimyGqZWzrYghkqPJe6xgbRjisJCjfwP+WQcXOu7oPB+KD/419XKrO9POqK1t6Oz3FQaMYrpKkDbgKyyO9BJObhiAW/rUBTl2LwYLIRYA+Xkqk0Dn2jc2Q6yItMKNqQ=="}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:17.791598 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-9a72056b-5998-4581-8184-7cdb944e7fd3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for project f3a2fec602684ab1a454b8da589b4787. Resources: {'key_pairs'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:37:17.796233 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-9a72056b-5998-4581-8184-7cdb944e7fd3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for user 9aa753d1e2c4430498d5b28f0304952f and project f3a2fec602684ab1a454b8da589b4787. Resources: {'key_pairs'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:37:17.817732 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9a72056b-5998-4581-8184-7cdb944e7fd3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045881 Aug 24 12:37:17.818322 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 281/570] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 12:37:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:18.770484 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-41e5aff3-42ad-41d3-97ec-b76b38235a27 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:18.771133 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-41e5aff3-42ad-41d3-97ec-b76b38235a27 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:18.778572 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-41e5aff3-42ad-41d3-97ec-b76b38235a27 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:18.779240 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-41e5aff3-42ad-41d3-97ec-b76b38235a27 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:18.779704 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-41e5aff3-42ad-41d3-97ec-b76b38235a27 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:18.780438 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-41e5aff3-42ad-41d3-97ec-b76b38235a27 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:18.780897 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-41e5aff3-42ad-41d3-97ec-b76b38235a27 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:18.781321 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-41e5aff3-42ad-41d3-97ec-b76b38235a27 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:18.806522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-41e5aff3-42ad-41d3-97ec-b76b38235a27 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Going to try to terminate instance {{(pid=127308) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:37:18.839826 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:18.888341 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-41e5aff3-42ad-41d3-97ec-b76b38235a27 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 204 len: 0 microversion: 2.1 time: 0.121613 Aug 24 12:37:18.889067 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 290/571] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:37:18 2022] DELETE /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:37:18.897292 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3eaca6f2-9b8f-4895-9dbe-55e419111fed tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:18.897911 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3eaca6f2-9b8f-4895-9dbe-55e419111fed tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:18.904935 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3eaca6f2-9b8f-4895-9dbe-55e419111fed tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:18.905427 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3eaca6f2-9b8f-4895-9dbe-55e419111fed tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:18.905867 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3eaca6f2-9b8f-4895-9dbe-55e419111fed tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:18.906569 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3eaca6f2-9b8f-4895-9dbe-55e419111fed tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:18.907033 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3eaca6f2-9b8f-4895-9dbe-55e419111fed tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:18.907485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3eaca6f2-9b8f-4895-9dbe-55e419111fed tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:19.067812 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-623764648", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6afd549-e037-4fe8-8751-48a00c7127d1"}], "security_groups": [{"name": "tempest-securitygroup--1781607306"}], "key_name": "tempest-keypair-1132293919", "user_data": "}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:19.071610 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-3eaca6f2-9b8f-4895-9dbe-55e419111fed tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:19.080366 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3eaca6f2-9b8f-4895-9dbe-55e419111fed tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1507 microversion: 2.1 time: 0.187257 Aug 24 12:37:19.081011 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 282/572] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:18 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1507 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:37:19.170446 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.network.neutron [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] validate_networks() for [('a6afd549-e037-4fe8-8751-48a00c7127d1', None, None, None, None, None)] {{(pid=127308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:37:19.452926 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-388fd100-e0be-4f31-b078-fea109b61701 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:19.455222 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-388fd100-e0be-4f31-b078-fea109b61701 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:19.461104 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-388fd100-e0be-4f31-b078-fea109b61701 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:19.461578 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-388fd100-e0be-4f31-b078-fea109b61701 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:19.462005 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-388fd100-e0be-4f31-b078-fea109b61701 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:19.462691 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-388fd100-e0be-4f31-b078-fea109b61701 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:19.463136 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-388fd100-e0be-4f31-b078-fea109b61701 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:19.463554 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-388fd100-e0be-4f31-b078-fea109b61701 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:19.468968 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:19.496457 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-388fd100-e0be-4f31-b078-fea109b61701 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047801 Aug 24 12:37:19.496946 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 283/573] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:19 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 12:37:19.552721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Flavor limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:37:19.553145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Image limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:37:19.553618 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Flavor pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:37:19.554055 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Image pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:37:19.554462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:37:19.558236 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d4febe3f-3a3e-4437-a306-af8b4c2cd955 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:19.558769 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d4febe3f-3a3e-4437-a306-af8b4c2cd955 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:19.563393 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:19.563935 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:19.564367 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:19.565162 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:19.565310 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4febe3f-3a3e-4437-a306-af8b4c2cd955 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:19.565609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:19.565796 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4febe3f-3a3e-4437-a306-af8b4c2cd955 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:19.566029 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:19.566233 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4febe3f-3a3e-4437-a306-af8b4c2cd955 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:19.566923 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4febe3f-3a3e-4437-a306-af8b4c2cd955 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:19.567381 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4febe3f-3a3e-4437-a306-af8b4c2cd955 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:19.567834 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4febe3f-3a3e-4437-a306-af8b4c2cd955 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:19.582640 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for project f3a2fec602684ab1a454b8da589b4787. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:37:19.586484 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Getting quotas for user 9aa753d1e2c4430498d5b28f0304952f and project f3a2fec602684ab1a454b8da589b4787. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:37:19.594053 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d4febe3f-3a3e-4437-a306-af8b4c2cd955 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Going to try to terminate instance {{(pid=127307) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:37:19.598203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Going to run 1 instances... {{(pid=127308) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:37:19.600644 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:37:19.648555 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4be01666-7971-443e-a470-910f0fc9b1c4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.585322 Aug 24 12:37:19.649369 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 291/574] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:37:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 12:37:19.661226 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b79e7241-1283-4a9a-9cd1-ebc491f50941 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:19.661830 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b79e7241-1283-4a9a-9cd1-ebc491f50941 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:19.679833 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d4febe3f-3a3e-4437-a306-af8b4c2cd955 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 204 len: 0 microversion: 2.1 time: 0.125055 Aug 24 12:37:19.680647 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 284/575] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:37:19 2022] DELETE /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:37:19.689092 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c6e4317f-8ae4-455a-8ae5-838e5c2b5242 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:19.689881 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c6e4317f-8ae4-455a-8ae5-838e5c2b5242 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:19.698207 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c6e4317f-8ae4-455a-8ae5-838e5c2b5242 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:19.698207 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c6e4317f-8ae4-455a-8ae5-838e5c2b5242 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:19.698207 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c6e4317f-8ae4-455a-8ae5-838e5c2b5242 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:19.698676 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c6e4317f-8ae4-455a-8ae5-838e5c2b5242 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:19.699268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c6e4317f-8ae4-455a-8ae5-838e5c2b5242 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:19.699772 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c6e4317f-8ae4-455a-8ae5-838e5c2b5242 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:19.723057 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b79e7241-1283-4a9a-9cd1-ebc491f50941 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:19.730440 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b79e7241-1283-4a9a-9cd1-ebc491f50941 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1241 microversion: 2.1 time: 0.072952 Aug 24 12:37:19.731865 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 292/576] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:19 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:37:19.841392 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c6e4317f-8ae4-455a-8ae5-838e5c2b5242 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:19.849533 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c6e4317f-8ae4-455a-8ae5-838e5c2b5242 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1671 microversion: 2.1 time: 0.164486 Aug 24 12:37:19.850204 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 285/577] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:19 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:20.101116 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d851dc55-2151-4b48-ba6f-61fb2079038b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:20.101772 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d851dc55-2151-4b48-ba6f-61fb2079038b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:20.109547 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d851dc55-2151-4b48-ba6f-61fb2079038b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:20.110024 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d851dc55-2151-4b48-ba6f-61fb2079038b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:20.110450 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d851dc55-2151-4b48-ba6f-61fb2079038b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:20.111128 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d851dc55-2151-4b48-ba6f-61fb2079038b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:20.111572 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d851dc55-2151-4b48-ba6f-61fb2079038b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:20.112011 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d851dc55-2151-4b48-ba6f-61fb2079038b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:20.240478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d851dc55-2151-4b48-ba6f-61fb2079038b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:20.248255 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d851dc55-2151-4b48-ba6f-61fb2079038b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1507 microversion: 2.1 time: 0.150973 Aug 24 12:37:20.248823 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 293/578] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:20 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:20.752050 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-62974236-eeb7-42db-b2fc-c2d5073f029c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:20.752661 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-62974236-eeb7-42db-b2fc-c2d5073f029c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:20.759291 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-62974236-eeb7-42db-b2fc-c2d5073f029c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:20.759817 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-62974236-eeb7-42db-b2fc-c2d5073f029c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:20.760259 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-62974236-eeb7-42db-b2fc-c2d5073f029c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:20.760952 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-62974236-eeb7-42db-b2fc-c2d5073f029c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:20.761413 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-62974236-eeb7-42db-b2fc-c2d5073f029c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:20.762389 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-62974236-eeb7-42db-b2fc-c2d5073f029c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:20.823109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-62974236-eeb7-42db-b2fc-c2d5073f029c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:20.831518 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-62974236-eeb7-42db-b2fc-c2d5073f029c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1245 microversion: 2.1 time: 0.083386 Aug 24 12:37:20.832122 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 286/579] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:20 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:20.872516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-868d6c4c-1e7f-4568-9828-aa416e4ce2a5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:20.873114 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-868d6c4c-1e7f-4568-9828-aa416e4ce2a5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:20.879178 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-868d6c4c-1e7f-4568-9828-aa416e4ce2a5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:20.879687 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-868d6c4c-1e7f-4568-9828-aa416e4ce2a5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:20.880118 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-868d6c4c-1e7f-4568-9828-aa416e4ce2a5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:20.880814 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-868d6c4c-1e7f-4568-9828-aa416e4ce2a5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:20.881397 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-868d6c4c-1e7f-4568-9828-aa416e4ce2a5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:20.881893 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-868d6c4c-1e7f-4568-9828-aa416e4ce2a5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:21.013536 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-868d6c4c-1e7f-4568-9828-aa416e4ce2a5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:21.021308 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-868d6c4c-1e7f-4568-9828-aa416e4ce2a5 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1671 microversion: 2.1 time: 0.153146 Aug 24 12:37:21.021885 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 294/580] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:20 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:21.268935 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2b5223d1-998c-4a5b-a1b1-b36a472a2892 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:21.269709 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2b5223d1-998c-4a5b-a1b1-b36a472a2892 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:21.275832 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2b5223d1-998c-4a5b-a1b1-b36a472a2892 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:21.276324 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2b5223d1-998c-4a5b-a1b1-b36a472a2892 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:21.276764 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2b5223d1-998c-4a5b-a1b1-b36a472a2892 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:21.278419 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2b5223d1-998c-4a5b-a1b1-b36a472a2892 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:21.278877 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2b5223d1-998c-4a5b-a1b1-b36a472a2892 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:21.279302 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2b5223d1-998c-4a5b-a1b1-b36a472a2892 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:21.421500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2b5223d1-998c-4a5b-a1b1-b36a472a2892 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:21.429237 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2b5223d1-998c-4a5b-a1b1-b36a472a2892 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1507 microversion: 2.1 time: 0.164269 Aug 24 12:37:21.429787 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 287/581] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:21 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:21.851984 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-53a8d773-aa01-4322-8227-fbd8480e3841 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:21.852592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-53a8d773-aa01-4322-8227-fbd8480e3841 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:21.859571 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53a8d773-aa01-4322-8227-fbd8480e3841 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:21.860084 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53a8d773-aa01-4322-8227-fbd8480e3841 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:21.860525 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53a8d773-aa01-4322-8227-fbd8480e3841 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:21.861209 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53a8d773-aa01-4322-8227-fbd8480e3841 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:21.861662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53a8d773-aa01-4322-8227-fbd8480e3841 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:21.862085 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-53a8d773-aa01-4322-8227-fbd8480e3841 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:21.924297 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-53a8d773-aa01-4322-8227-fbd8480e3841 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:21.931739 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-53a8d773-aa01-4322-8227-fbd8480e3841 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1245 microversion: 2.1 time: 0.083543 Aug 24 12:37:21.932309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 295/582] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:21 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:22.042276 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5058401e-cd0e-42ef-9557-b65fdbb41988 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:22.042887 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5058401e-cd0e-42ef-9557-b65fdbb41988 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:22.049445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5058401e-cd0e-42ef-9557-b65fdbb41988 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.049934 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5058401e-cd0e-42ef-9557-b65fdbb41988 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.050374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5058401e-cd0e-42ef-9557-b65fdbb41988 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:22.051065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5058401e-cd0e-42ef-9557-b65fdbb41988 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.051521 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5058401e-cd0e-42ef-9557-b65fdbb41988 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.051972 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5058401e-cd0e-42ef-9557-b65fdbb41988 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:22.286029 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5058401e-cd0e-42ef-9557-b65fdbb41988 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:22.293948 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5058401e-cd0e-42ef-9557-b65fdbb41988 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1671 microversion: 2.1 time: 0.255353 Aug 24 12:37:22.294511 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 288/583] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:22 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1671 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:22.451679 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-da50785b-892e-48a7-adb7-7b862548bf9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:22.452202 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-da50785b-892e-48a7-adb7-7b862548bf9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:22.458160 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da50785b-892e-48a7-adb7-7b862548bf9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.458636 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da50785b-892e-48a7-adb7-7b862548bf9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.459062 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da50785b-892e-48a7-adb7-7b862548bf9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:22.459771 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da50785b-892e-48a7-adb7-7b862548bf9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.460224 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da50785b-892e-48a7-adb7-7b862548bf9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.460636 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da50785b-892e-48a7-adb7-7b862548bf9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:22.801507 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-da50785b-892e-48a7-adb7-7b862548bf9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:22.811939 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-da50785b-892e-48a7-adb7-7b862548bf9b tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1507 microversion: 2.1 time: 0.365126 Aug 24 12:37:22.812762 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 296/584] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:22 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:22.952565 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-25f6e8eb-a8cc-40ba-a827-e593031b4d1c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:22.954805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-25f6e8eb-a8cc-40ba-a827-e593031b4d1c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:22.962610 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-25f6e8eb-a8cc-40ba-a827-e593031b4d1c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.963388 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-25f6e8eb-a8cc-40ba-a827-e593031b4d1c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.963597 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-25f6e8eb-a8cc-40ba-a827-e593031b4d1c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:22.964300 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-25f6e8eb-a8cc-40ba-a827-e593031b4d1c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.964841 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-25f6e8eb-a8cc-40ba-a827-e593031b4d1c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.966006 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-25f6e8eb-a8cc-40ba-a827-e593031b4d1c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:23.026526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-25f6e8eb-a8cc-40ba-a827-e593031b4d1c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:23.035178 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-25f6e8eb-a8cc-40ba-a827-e593031b4d1c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1293 microversion: 2.1 time: 0.087392 Aug 24 12:37:23.035776 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 289/585] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:22 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:23.316103 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-943c13e2-ac7d-4c06-a5d3-e4d69bfd4794 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:23.317384 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-943c13e2-ac7d-4c06-a5d3-e4d69bfd4794 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:23.330685 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-943c13e2-ac7d-4c06-a5d3-e4d69bfd4794 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:23.331512 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-943c13e2-ac7d-4c06-a5d3-e4d69bfd4794 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:23.332138 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-943c13e2-ac7d-4c06-a5d3-e4d69bfd4794 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:23.333013 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-943c13e2-ac7d-4c06-a5d3-e4d69bfd4794 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:23.333609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-943c13e2-ac7d-4c06-a5d3-e4d69bfd4794 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:23.334407 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-943c13e2-ac7d-4c06-a5d3-e4d69bfd4794 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:23.400748 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-b2826f42-9269-49a0-993a-d62a5593fcf1 req-369dfa1f-9666-4163-b729-3f1ae84a9110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8467a7d-419f-4ec3-a8c5-d513d1ef2149", "name": "network-vif-deleted", "tag": "14960f8e-911e-4c24-a6f8-8995dd4f8bab"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:23.417602 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b2826f42-9269-49a0-993a-d62a5593fcf1 req-369dfa1f-9666-4163-b729-3f1ae84a9110 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:23.421352 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b2826f42-9269-49a0-993a-d62a5593fcf1 req-369dfa1f-9666-4163-b729-3f1ae84a9110 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:23.425087 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b2826f42-9269-49a0-993a-d62a5593fcf1 req-369dfa1f-9666-4163-b729-3f1ae84a9110 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:23.462940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-b2826f42-9269-49a0-993a-d62a5593fcf1 req-369dfa1f-9666-4163-b729-3f1ae84a9110 service nova] Creating event network-vif-deleted:14960f8e-911e-4c24-a6f8-8995dd4f8bab for instance d8467a7d-419f-4ec3-a8c5-d513d1ef2149 on hv-cinder-84890 Aug 24 12:37:23.489992 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-b2826f42-9269-49a0-993a-d62a5593fcf1 req-369dfa1f-9666-4163-b729-3f1ae84a9110 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092699 Aug 24 12:37:23.494567 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 290/586] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:23.589861 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-943c13e2-ac7d-4c06-a5d3-e4d69bfd4794 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:23.598299 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-943c13e2-ac7d-4c06-a5d3-e4d69bfd4794 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1671 microversion: 2.1 time: 0.286888 Aug 24 12:37:23.598869 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 297/587] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:23 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1671 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:23.833698 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-86f32464-52ac-4c1a-8ac0-180379f59acc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:23.834730 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-86f32464-52ac-4c1a-8ac0-180379f59acc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:23.842106 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-86f32464-52ac-4c1a-8ac0-180379f59acc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:23.842597 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-86f32464-52ac-4c1a-8ac0-180379f59acc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:23.843176 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-86f32464-52ac-4c1a-8ac0-180379f59acc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:23.843919 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-86f32464-52ac-4c1a-8ac0-180379f59acc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:23.844682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-86f32464-52ac-4c1a-8ac0-180379f59acc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:23.844818 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-86f32464-52ac-4c1a-8ac0-180379f59acc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:23.877969 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-86f32464-52ac-4c1a-8ac0-180379f59acc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:23.878453 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-86f32464-52ac-4c1a-8ac0-180379f59acc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:23.879066 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-86f32464-52ac-4c1a-8ac0-180379f59acc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:23.879697 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.objects.instance [None req-86f32464-52ac-4c1a-8ac0-180379f59acc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lazy-loading 'fault' on Instance uuid d8467a7d-419f-4ec3-a8c5-d513d1ef2149 {{(pid=127307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:37:23.943114 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-86f32464-52ac-4c1a-8ac0-180379f59acc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:23.956193 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-86f32464-52ac-4c1a-8ac0-180379f59acc tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 200 len: 1312 microversion: 2.1 time: 0.125929 Aug 24 12:37:23.962021 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 291/588] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:23 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 1312 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:24.061488 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-3c30d236-e1d2-49b5-a395-a8601184335b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:24.062577 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-3c30d236-e1d2-49b5-a395-a8601184335b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:24.071612 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3c30d236-e1d2-49b5-a395-a8601184335b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:24.072155 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3c30d236-e1d2-49b5-a395-a8601184335b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:24.072650 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3c30d236-e1d2-49b5-a395-a8601184335b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:24.073582 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3c30d236-e1d2-49b5-a395-a8601184335b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:24.074062 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3c30d236-e1d2-49b5-a395-a8601184335b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:24.075366 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3c30d236-e1d2-49b5-a395-a8601184335b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:24.150617 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-3c30d236-e1d2-49b5-a395-a8601184335b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:24.159015 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-3c30d236-e1d2-49b5-a395-a8601184335b tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1299 microversion: 2.1 time: 0.106259 Aug 24 12:37:24.161387 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 298/589] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:24 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:24.620392 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-23b6b901-db82-4213-a2d5-201463ce0ff8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:24.621671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-23b6b901-db82-4213-a2d5-201463ce0ff8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:24.628364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-23b6b901-db82-4213-a2d5-201463ce0ff8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:24.629081 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-23b6b901-db82-4213-a2d5-201463ce0ff8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:24.630830 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-23b6b901-db82-4213-a2d5-201463ce0ff8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:24.631760 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-23b6b901-db82-4213-a2d5-201463ce0ff8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:24.632373 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-23b6b901-db82-4213-a2d5-201463ce0ff8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:24.633015 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-23b6b901-db82-4213-a2d5-201463ce0ff8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:24.667104 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-23b6b901-db82-4213-a2d5-201463ce0ff8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:24.667590 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-23b6b901-db82-4213-a2d5-201463ce0ff8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:24.668713 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-23b6b901-db82-4213-a2d5-201463ce0ff8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:24.669227 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.objects.instance [None req-23b6b901-db82-4213-a2d5-201463ce0ff8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lazy-loading 'fault' on Instance uuid c2cf1c28-43da-4dce-9f29-d2a486ef88ab {{(pid=127307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:37:24.731821 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-23b6b901-db82-4213-a2d5-201463ce0ff8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:24.739889 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-23b6b901-db82-4213-a2d5-201463ce0ff8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 200 len: 1327 microversion: 2.1 time: 0.123205 Aug 24 12:37:24.740826 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 292/590] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:24 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 1327 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:24.977027 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c81fd9f5-537f-48b7-b3fd-56b8f22f8094 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:24.977635 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c81fd9f5-537f-48b7-b3fd-56b8f22f8094 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: d8467a7d-419f-4ec3-a8c5-d513d1ef2149] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:24.984975 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c81fd9f5-537f-48b7-b3fd-56b8f22f8094 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:24.985954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c81fd9f5-537f-48b7-b3fd-56b8f22f8094 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:24.986276 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c81fd9f5-537f-48b7-b3fd-56b8f22f8094 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:24.987229 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c81fd9f5-537f-48b7-b3fd-56b8f22f8094 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:24.987787 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c81fd9f5-537f-48b7-b3fd-56b8f22f8094 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:24.988414 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c81fd9f5-537f-48b7-b3fd-56b8f22f8094 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.005869 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-c81fd9f5-537f-48b7-b3fd-56b8f22f8094 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] HTTP exception thrown: Instance d8467a7d-419f-4ec3-a8c5-d513d1ef2149 could not be found. Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c81fd9f5-537f-48b7-b3fd-56b8f22f8094 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Request method failure captured: Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 HTTP/1.1 Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhptNH4mn2TVQcU78gzQc_MEi0EjKa375myyVyDI0kkHg9_so0vJnb2xQ2TdCUf0V4s8LQu4JeSt7iwuhXjPBZKJOkVhmKBO25mKo4XuZDYED7arR8J9UwMqw0S3d9pXZhfromF_FuF00GG74qKZE1M9iai6jJhDaaYLQDZCCnQB9j8 Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 9afa0216c9e140bb82f56f14ccfb7bb6 Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1748371241 Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:37:25.008262 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:37:25.009951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:37:25.009951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1748371241 Aug 24 12:37:25.009951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 9afa0216c9e140bb82f56f14ccfb7bb6 Aug 24 12:37:25.009951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1748371241 Aug 24 12:37:25.009951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-ServerRescueNegativeTestJSON-1748371241-project Aug 24 12:37:25.009951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:37:25.009951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:37:25.009951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 9138ac21bbdb4577a7f43b5ab471d572 Aug 24 12:37:25.009951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1748371241-project Aug 24 12:37:25.009951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:37:25.009951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance d8467a7d-419f-4ec3-a8c5-d513d1ef2149 could not be found. Aug 24 12:37:25.009951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': 'd8467a7d-419f-4ec3-a8c5-d513d1ef2149'} Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8467a7d-419f-4ec3-a8c5-d513d1ef2149 could not be found. Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:37:25.010957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8467a7d-419f-4ec3-a8c5-d513d1ef2149 could not be found. Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8467a7d-419f-4ec3-a8c5-d513d1ef2149 could not be found. Aug 24 12:37:25.013722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:37:25.014802 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c81fd9f5-537f-48b7-b3fd-56b8f22f8094 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Returning 404 to user: Instance d8467a7d-419f-4ec3-a8c5-d513d1ef2149 could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:37:25.014802 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c81fd9f5-537f-48b7-b3fd-56b8f22f8094 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149" status: 404 len: 111 microversion: 2.1 time: 0.037906 Aug 24 12:37:25.014802 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 299/591] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:24 2022] GET /compute/v2.1/servers/d8467a7d-419f-4ec3-a8c5-d513d1ef2149 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:37:25.020515 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f3c2c098-5876-41ad-8c99-ff323ff9d660 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:25.020845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f3c2c098-5876-41ad-8c99-ff323ff9d660 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:25.026877 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3c2c098-5876-41ad-8c99-ff323ff9d660 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:25.028013 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3c2c098-5876-41ad-8c99-ff323ff9d660 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:25.028459 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3c2c098-5876-41ad-8c99-ff323ff9d660 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.029167 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3c2c098-5876-41ad-8c99-ff323ff9d660 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:25.029626 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3c2c098-5876-41ad-8c99-ff323ff9d660 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:25.030051 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3c2c098-5876-41ad-8c99-ff323ff9d660 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.060278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f3c2c098-5876-41ad-8c99-ff323ff9d660 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Going to try to terminate instance {{(pid=127307) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:37:25.151434 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f3c2c098-5876-41ad-8c99-ff323ff9d660 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 204 len: 0 microversion: 2.1 time: 0.134229 Aug 24 12:37:25.152380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 293/592] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:37:25 2022] DELETE /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:37:25.160659 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a2759abe-8fc7-4fb4-ac5d-66fe9d392152 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:25.161796 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-a2759abe-8fc7-4fb4-ac5d-66fe9d392152 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:25.171359 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a2759abe-8fc7-4fb4-ac5d-66fe9d392152 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:25.172017 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a2759abe-8fc7-4fb4-ac5d-66fe9d392152 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:25.172584 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a2759abe-8fc7-4fb4-ac5d-66fe9d392152 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.173950 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a2759abe-8fc7-4fb4-ac5d-66fe9d392152 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:25.174593 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a2759abe-8fc7-4fb4-ac5d-66fe9d392152 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:25.175575 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a2759abe-8fc7-4fb4-ac5d-66fe9d392152 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.181016 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-80d90a85-10f8-488d-9a99-f5850ddeae6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:25.181717 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-80d90a85-10f8-488d-9a99-f5850ddeae6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:25.188341 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-80d90a85-10f8-488d-9a99-f5850ddeae6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:25.189413 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-80d90a85-10f8-488d-9a99-f5850ddeae6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:25.190021 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-80d90a85-10f8-488d-9a99-f5850ddeae6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.190885 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-80d90a85-10f8-488d-9a99-f5850ddeae6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:25.191331 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-80d90a85-10f8-488d-9a99-f5850ddeae6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:25.192548 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-80d90a85-10f8-488d-9a99-f5850ddeae6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.488392 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-80d90a85-10f8-488d-9a99-f5850ddeae6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:25.497931 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-80d90a85-10f8-488d-9a99-f5850ddeae6a tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1367 microversion: 2.1 time: 0.320856 Aug 24 12:37:25.511747 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 294/593] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:25 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1367 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:37:25.514581 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-a2759abe-8fc7-4fb4-ac5d-66fe9d392152 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:25.518472 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-566507f4-849b-41e4-bcba-535295debbed req-4784995f-314c-43af-aab4-4bd04af0ecdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "812d57c7-7fbf-4d11-bc76-a23e9ae9f394", "tag": "10113451-b2c5-4e51-a5e5-9b48dbc8798e"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:25.524423 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a2759abe-8fc7-4fb4-ac5d-66fe9d392152 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.367987 Aug 24 12:37:25.526077 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 300/594] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:25 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:25.530422 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-566507f4-849b-41e4-bcba-535295debbed req-4784995f-314c-43af-aab4-4bd04af0ecdc service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:25.531062 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-566507f4-849b-41e4-bcba-535295debbed req-4784995f-314c-43af-aab4-4bd04af0ecdc service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:25.531732 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-566507f4-849b-41e4-bcba-535295debbed req-4784995f-314c-43af-aab4-4bd04af0ecdc service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.531887 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-d22977e4-ee9a-4ddf-9065-f00470638084 req-1ecf3fdf-a77d-47bf-b9d4-e4105008a9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cf1c28-43da-4dce-9f29-d2a486ef88ab", "name": "network-vif-deleted", "tag": "d41d285f-5608-4807-8786-de42cb2d695e"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:25.543612 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-566507f4-849b-41e4-bcba-535295debbed req-4784995f-314c-43af-aab4-4bd04af0ecdc service nova] Creating event network-changed:10113451-b2c5-4e51-a5e5-9b48dbc8798e for instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 on hv-cinder-84890 Aug 24 12:37:25.546391 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-d22977e4-ee9a-4ddf-9065-f00470638084 req-1ecf3fdf-a77d-47bf-b9d4-e4105008a9b7 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:25.546937 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-d22977e4-ee9a-4ddf-9065-f00470638084 req-1ecf3fdf-a77d-47bf-b9d4-e4105008a9b7 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:25.547439 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-d22977e4-ee9a-4ddf-9065-f00470638084 req-1ecf3fdf-a77d-47bf-b9d4-e4105008a9b7 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.549219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-566507f4-849b-41e4-bcba-535295debbed req-4784995f-314c-43af-aab4-4bd04af0ecdc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036040 Aug 24 12:37:25.549803 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 295/595] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:25.558982 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-d22977e4-ee9a-4ddf-9065-f00470638084 req-1ecf3fdf-a77d-47bf-b9d4-e4105008a9b7 service nova] Creating event network-vif-deleted:d41d285f-5608-4807-8786-de42cb2d695e for instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab on hv-cinder-84890 Aug 24 12:37:25.563763 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-d22977e4-ee9a-4ddf-9065-f00470638084 req-1ecf3fdf-a77d-47bf-b9d4-e4105008a9b7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036378 Aug 24 12:37:25.564343 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 301/596] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:25.761349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-98c12438-1e8a-498f-ad10-95d711a1e9a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:25.762669 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-98c12438-1e8a-498f-ad10-95d711a1e9a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:25.768832 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-98c12438-1e8a-498f-ad10-95d711a1e9a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:25.769317 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-98c12438-1e8a-498f-ad10-95d711a1e9a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:25.769748 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-98c12438-1e8a-498f-ad10-95d711a1e9a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.770439 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-98c12438-1e8a-498f-ad10-95d711a1e9a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:25.770893 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-98c12438-1e8a-498f-ad10-95d711a1e9a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:25.771316 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-98c12438-1e8a-498f-ad10-95d711a1e9a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.787909 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-98c12438-1e8a-498f-ad10-95d711a1e9a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] HTTP exception thrown: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-98c12438-1e8a-498f-ad10-95d711a1e9a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Request method failure captured: Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab HTTP/1.1 Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhplsuIjfxBizWlk2GTc6OwB0NAv2--8K3n4Uq18iQ-WuP2-sfoghLCm_b2-dA07neiLMaZMzQYZdfmVINt5LQ2wKvb3DIBqrP0lK0t1H7ep_nerjij3idaG05KL5Q04kJlFo2zNaAz6HZxQ91eaaEscvzdytHSBtlBJ9iOeHAvf3rw Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: 36bd9970f0694314b966d86f13b83d4b Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:37:25.789526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:37:25.791079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:37:25.791079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:37:25.791079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: 36bd9970f0694314b966d86f13b83d4b Aug 24 12:37:25.791079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:37:25.791079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeTestJSON-881897809-project Aug 24 12:37:25.791079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:37:25.791079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:37:25.791079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: ed0d97f3f08f46af851492aee6a8d0ef Aug 24 12:37:25.791079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeTestJSON-881897809-project Aug 24 12:37:25.791079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:37:25.791079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. Aug 24 12:37:25.791079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': 'c2cf1c28-43da-4dce-9f29-d2a486ef88ab'} Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:37:25.792032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. Aug 24 12:37:25.793585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:25.794845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-98c12438-1e8a-498f-ad10-95d711a1e9a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Returning 404 to user: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:37:25.794845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-98c12438-1e8a-498f-ad10-95d711a1e9a9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 404 len: 111 microversion: 2.1 time: 0.033970 Aug 24 12:37:25.794845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 296/597] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:25 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:37:25.800611 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b1058488-67f5-45f6-8754-97f39196d982 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '.version_select at 0x7f4696c07040>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:25.818363 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b1058488-67f5-45f6-8754-97f39196d982 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1485284997" status: 202 len: 0 microversion: 2.1 time: 0.021917 Aug 24 12:37:25.818915 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 302/598] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 24 12:37:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1485284997 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:37:26.451042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-288fcbe7-3112-4be3-82ef-eede36b817fb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Action: 'create', calling method: .version_select at 0x7f46973b2430>, body: {"keypair": {"name": "tempest-keypair-1218538827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSBwk+bFmd7j2JF/5y2rqtqRjtG37WQnwhua0LT8hngdtqDshzwmUcTktemj3LaO8ReEIesx12b6rAicBN5gUDUyP2fV5W6SwpI/jAiGEZBkyA6OTGcUyajDHh/x3nDPg=="}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:26.466239 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-288fcbe7-3112-4be3-82ef-eede36b817fb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Getting quotas for project 36bd9970f0694314b966d86f13b83d4b. Resources: {'key_pairs'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:37:26.469919 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-288fcbe7-3112-4be3-82ef-eede36b817fb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Getting quotas for user ed0d97f3f08f46af851492aee6a8d0ef and project 36bd9970f0694314b966d86f13b83d4b. Resources: {'key_pairs'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:37:26.472386 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:26.494372 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-288fcbe7-3112-4be3-82ef-eede36b817fb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048073 Aug 24 12:37:26.494960 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 297/599] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 12:37:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:26.518810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b4a1e323-0db3-41cb-a1a1-e11210ec004f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:26.519563 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b4a1e323-0db3-41cb-a1a1-e11210ec004f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:26.526018 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4a1e323-0db3-41cb-a1a1-e11210ec004f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:26.526607 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4a1e323-0db3-41cb-a1a1-e11210ec004f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:26.527187 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4a1e323-0db3-41cb-a1a1-e11210ec004f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:26.528214 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4a1e323-0db3-41cb-a1a1-e11210ec004f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:26.528649 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4a1e323-0db3-41cb-a1a1-e11210ec004f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:26.529098 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b4a1e323-0db3-41cb-a1a1-e11210ec004f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:26.547147 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-1afb8114-37f6-49f5-a136-75dbf7ae10d1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:26.548846 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-1afb8114-37f6-49f5-a136-75dbf7ae10d1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:26.557184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1afb8114-37f6-49f5-a136-75dbf7ae10d1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:26.557971 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1afb8114-37f6-49f5-a136-75dbf7ae10d1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:26.559368 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1afb8114-37f6-49f5-a136-75dbf7ae10d1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:26.560414 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1afb8114-37f6-49f5-a136-75dbf7ae10d1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:26.561227 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1afb8114-37f6-49f5-a136-75dbf7ae10d1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:26.561924 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1afb8114-37f6-49f5-a136-75dbf7ae10d1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:26.797957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b4a1e323-0db3-41cb-a1a1-e11210ec004f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:26.809489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b4a1e323-0db3-41cb-a1a1-e11210ec004f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1367 microversion: 2.1 time: 0.294397 Aug 24 12:37:26.810612 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 303/600] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:26 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:26.815036 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-1afb8114-37f6-49f5-a136-75dbf7ae10d1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:26.825001 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:26.830456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-1afb8114-37f6-49f5-a136-75dbf7ae10d1 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.288799 Aug 24 12:37:26.831039 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 298/601] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:26 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:37:27.830511 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-50752a00-23fd-4fd7-b2b0-693a49bc2159 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:27.831118 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-50752a00-23fd-4fd7-b2b0-693a49bc2159 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:27.837461 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-50752a00-23fd-4fd7-b2b0-693a49bc2159 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:27.837893 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-50752a00-23fd-4fd7-b2b0-693a49bc2159 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:27.838316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-50752a00-23fd-4fd7-b2b0-693a49bc2159 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:27.838986 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-50752a00-23fd-4fd7-b2b0-693a49bc2159 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:27.840243 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-50752a00-23fd-4fd7-b2b0-693a49bc2159 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:27.840666 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-50752a00-23fd-4fd7-b2b0-693a49bc2159 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:27.852475 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5f4fb755-afc6-4a54-88a8-d8788f6a2e84 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:27.853261 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5f4fb755-afc6-4a54-88a8-d8788f6a2e84 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:27.862017 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5f4fb755-afc6-4a54-88a8-d8788f6a2e84 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:27.862505 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5f4fb755-afc6-4a54-88a8-d8788f6a2e84 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:27.862941 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5f4fb755-afc6-4a54-88a8-d8788f6a2e84 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:27.863651 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5f4fb755-afc6-4a54-88a8-d8788f6a2e84 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:27.864105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5f4fb755-afc6-4a54-88a8-d8788f6a2e84 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:27.864521 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5f4fb755-afc6-4a54-88a8-d8788f6a2e84 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:28.051234 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-50752a00-23fd-4fd7-b2b0-693a49bc2159 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:28.055143 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5f4fb755-afc6-4a54-88a8-d8788f6a2e84 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:28.059227 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-50752a00-23fd-4fd7-b2b0-693a49bc2159 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1367 microversion: 2.1 time: 0.232319 Aug 24 12:37:28.059912 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 304/602] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:27 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:28.064734 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-906232225", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9c96c4a-d3b6-4e77-bd97-a11060309e95"}], "security_groups": [{"name": "tempest-securitygroup--894151867"}], "key_name": "tempest-keypair-1218538827", "user_data": "}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:28.066046 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5f4fb755-afc6-4a54-88a8-d8788f6a2e84 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1522 microversion: 2.1 time: 0.218133 Aug 24 12:37:28.066703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 299/603] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:27 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:37:28.167441 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.network.neutron [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] validate_networks() for [('c9c96c4a-d3b6-4e77-bd97-a11060309e95', None, None, None, None, None)] {{(pid=127308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:37:28.460160 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:28.750317 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-8b4d7f80-b944-447e-844e-5dbb23b6bfa9 req-b961ad18-2fe5-4f9b-a96a-7ee0b1baa4ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3027685-43d2-43dc-92d2-ac44b036c061", "name": "network-vif-deleted", "tag": "c9418bfd-867a-4096-a9ce-235b0174885a"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:28.762577 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-8b4d7f80-b944-447e-844e-5dbb23b6bfa9 req-b961ad18-2fe5-4f9b-a96a-7ee0b1baa4ca service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:28.763428 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-8b4d7f80-b944-447e-844e-5dbb23b6bfa9 req-b961ad18-2fe5-4f9b-a96a-7ee0b1baa4ca service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:28.763992 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-8b4d7f80-b944-447e-844e-5dbb23b6bfa9 req-b961ad18-2fe5-4f9b-a96a-7ee0b1baa4ca service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:28.780255 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-8b4d7f80-b944-447e-844e-5dbb23b6bfa9 req-b961ad18-2fe5-4f9b-a96a-7ee0b1baa4ca service nova] Creating event network-vif-deleted:c9418bfd-867a-4096-a9ce-235b0174885a for instance a3027685-43d2-43dc-92d2-ac44b036c061 on hv-cinder-84890 Aug 24 12:37:28.786033 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-8b4d7f80-b944-447e-844e-5dbb23b6bfa9 req-b961ad18-2fe5-4f9b-a96a-7ee0b1baa4ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038602 Aug 24 12:37:28.787212 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 300/604] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:37:28.814324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Flavor limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:37:28.814742 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Image limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:37:28.815211 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Flavor pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:37:28.816055 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Image pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:37:28.816469 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:37:28.827374 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:28.827972 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:28.828406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:28.829125 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:28.829779 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:28.830197 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:28.850506 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Getting quotas for project 36bd9970f0694314b966d86f13b83d4b. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:37:28.855532 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Getting quotas for user ed0d97f3f08f46af851492aee6a8d0ef and project 36bd9970f0694314b966d86f13b83d4b. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:37:28.866728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Going to run 1 instances... {{(pid=127308) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:37:28.869054 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:37:28.922724 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1741bc46-93c4-4da2-9ae4-16b483f24315 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.861784 Aug 24 12:37:28.923505 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 305/605] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:37:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:37:28.934684 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f2b2cb8a-48c4-4370-b531-576e1dd28665 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:28.935384 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f2b2cb8a-48c4-4370-b531-576e1dd28665 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:28.991162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f2b2cb8a-48c4-4370-b531-576e1dd28665 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:28.998032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f2b2cb8a-48c4-4370-b531-576e1dd28665 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1237 microversion: 2.1 time: 0.067529 Aug 24 12:37:28.998709 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 301/606] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:28 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:29.081328 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-6c2cb8d0-f750-4ab2-817f-396b8efdb7c6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:29.084507 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-6c2cb8d0-f750-4ab2-817f-396b8efdb7c6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:29.092084 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6c2cb8d0-f750-4ab2-817f-396b8efdb7c6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:29.092787 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6c2cb8d0-f750-4ab2-817f-396b8efdb7c6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:29.093415 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6c2cb8d0-f750-4ab2-817f-396b8efdb7c6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:29.093538 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f6510a77-90b1-4944-bc6c-a11a2f2d9266 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:29.094118 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f6510a77-90b1-4944-bc6c-a11a2f2d9266 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:29.094686 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6c2cb8d0-f750-4ab2-817f-396b8efdb7c6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:29.095284 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6c2cb8d0-f750-4ab2-817f-396b8efdb7c6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:29.095886 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6c2cb8d0-f750-4ab2-817f-396b8efdb7c6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:29.107924 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f6510a77-90b1-4944-bc6c-a11a2f2d9266 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:29.108428 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f6510a77-90b1-4944-bc6c-a11a2f2d9266 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:29.108943 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f6510a77-90b1-4944-bc6c-a11a2f2d9266 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:29.109826 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f6510a77-90b1-4944-bc6c-a11a2f2d9266 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:29.110497 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f6510a77-90b1-4944-bc6c-a11a2f2d9266 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:29.111133 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f6510a77-90b1-4944-bc6c-a11a2f2d9266 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:29.149585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f6510a77-90b1-4944-bc6c-a11a2f2d9266 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:29.150262 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f6510a77-90b1-4944-bc6c-a11a2f2d9266 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:29.150900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f6510a77-90b1-4944-bc6c-a11a2f2d9266 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:29.151499 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.objects.instance [None req-f6510a77-90b1-4944-bc6c-a11a2f2d9266 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lazy-loading 'fault' on Instance uuid a3027685-43d2-43dc-92d2-ac44b036c061 {{(pid=127307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:37:29.264921 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f6510a77-90b1-4944-bc6c-a11a2f2d9266 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9138ac21bbdb4577a7f43b5ab471d572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9afa0216c9e140bb82f56f14ccfb7bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:29.295666 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f6510a77-90b1-4944-bc6c-a11a2f2d9266 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 200 len: 1312 microversion: 2.1 time: 0.209497 Aug 24 12:37:29.296918 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 302/607] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:29 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 1312 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:29.357976 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6c2cb8d0-f750-4ab2-817f-396b8efdb7c6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:29.366095 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-6c2cb8d0-f750-4ab2-817f-396b8efdb7c6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1367 microversion: 2.1 time: 0.288874 Aug 24 12:37:29.366650 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 306/608] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:29 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:30.007161 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-feca20cf-03a1-472e-aa52-235e0336ce62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:30.007724 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-feca20cf-03a1-472e-aa52-235e0336ce62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:30.015125 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-feca20cf-03a1-472e-aa52-235e0336ce62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:30.015643 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-feca20cf-03a1-472e-aa52-235e0336ce62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:30.016081 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-feca20cf-03a1-472e-aa52-235e0336ce62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:30.017622 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-feca20cf-03a1-472e-aa52-235e0336ce62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:30.017622 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-feca20cf-03a1-472e-aa52-235e0336ce62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:30.017816 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-feca20cf-03a1-472e-aa52-235e0336ce62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:30.022036 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9e203d5a-9501-47fc-b81e-e4dacfe5f1ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:30.023195 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9e203d5a-9501-47fc-b81e-e4dacfe5f1ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:30.030168 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9e203d5a-9501-47fc-b81e-e4dacfe5f1ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:30.030663 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9e203d5a-9501-47fc-b81e-e4dacfe5f1ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:30.031100 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9e203d5a-9501-47fc-b81e-e4dacfe5f1ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:30.031832 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9e203d5a-9501-47fc-b81e-e4dacfe5f1ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:30.032288 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9e203d5a-9501-47fc-b81e-e4dacfe5f1ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:30.032712 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9e203d5a-9501-47fc-b81e-e4dacfe5f1ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:30.044314 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-feca20cf-03a1-472e-aa52-235e0336ce62 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a/ips" status: 200 len: 151 microversion: 2.20 time: 0.041528 Aug 24 12:37:30.044891 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 303/609] 10.222.0.58 () {60 vars in 1289 bytes} [Wed Aug 24 12:37:30 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:30.098359 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9e203d5a-9501-47fc-b81e-e4dacfe5f1ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:30.106583 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9e203d5a-9501-47fc-b81e-e4dacfe5f1ad tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1233 microversion: 2.1 time: 0.091678 Aug 24 12:37:30.107151 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 307/610] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:30 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1233 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:37:30.318171 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-834df19f-8a62-4285-8edb-b729c6dbb9b8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:30.319098 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-834df19f-8a62-4285-8edb-b729c6dbb9b8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] [instance: a3027685-43d2-43dc-92d2-ac44b036c061] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:30.327284 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-834df19f-8a62-4285-8edb-b729c6dbb9b8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:30.328364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-834df19f-8a62-4285-8edb-b729c6dbb9b8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:30.329024 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-834df19f-8a62-4285-8edb-b729c6dbb9b8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:30.330008 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-834df19f-8a62-4285-8edb-b729c6dbb9b8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:30.330467 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-834df19f-8a62-4285-8edb-b729c6dbb9b8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:30.330887 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-834df19f-8a62-4285-8edb-b729c6dbb9b8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:30.348466 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-834df19f-8a62-4285-8edb-b729c6dbb9b8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] HTTP exception thrown: Instance a3027685-43d2-43dc-92d2-ac44b036c061 could not be found. Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-834df19f-8a62-4285-8edb-b729c6dbb9b8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Request method failure captured: Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 HTTP/1.1 Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhptNH4mn2TVQcU78gzQc_MEi0EjKa375myyVyDI0kkHg9_so0vJnb2xQ2TdCUf0V4s8LQu4JeSt7iwuhXjPBZKJOkVhmKBO25mKo4XuZDYED7arR8J9UwMqw0S3d9pXZhfromF_FuF00GG74qKZE1M9iai6jJhDaaYLQDZCCnQB9j8 Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: 9afa0216c9e140bb82f56f14ccfb7bb6 Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1748371241 Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:37:30.350704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:37:30.352278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9afa0216c9e140bb82f56f14ccfb7bb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:37:30.352278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1748371241 Aug 24 12:37:30.352278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: 9afa0216c9e140bb82f56f14ccfb7bb6 Aug 24 12:37:30.352278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1748371241 Aug 24 12:37:30.352278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-ServerRescueNegativeTestJSON-1748371241-project Aug 24 12:37:30.352278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:37:30.352278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:37:30.352278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 9138ac21bbdb4577a7f43b5ab471d572 Aug 24 12:37:30.352278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1748371241-project Aug 24 12:37:30.352278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:37:30.352278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance a3027685-43d2-43dc-92d2-ac44b036c061 could not be found. Aug 24 12:37:30.352278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': 'a3027685-43d2-43dc-92d2-ac44b036c061'} Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3027685-43d2-43dc-92d2-ac44b036c061 could not be found. Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:37:30.353057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3027685-43d2-43dc-92d2-ac44b036c061 could not be found. Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3027685-43d2-43dc-92d2-ac44b036c061 could not be found. Aug 24 12:37:30.358962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:37:30.361116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-834df19f-8a62-4285-8edb-b729c6dbb9b8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] Returning 404 to user: Instance a3027685-43d2-43dc-92d2-ac44b036c061 could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:37:30.361116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-834df19f-8a62-4285-8edb-b729c6dbb9b8 tempest-ServerRescueNegativeTestJSON-1748371241 tempest-ServerRescueNegativeTestJSON-1748371241-project] 10.222.0.58 "GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061" status: 404 len: 111 microversion: 2.1 time: 0.040081 Aug 24 12:37:30.361116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 304/611] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:30 2022] GET /compute/v2.1/servers/a3027685-43d2-43dc-92d2-ac44b036c061 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:37:30.386195 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ce736097-49e7-4684-bcfc-63987373b925 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:30.386886 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-ce736097-49e7-4684-bcfc-63987373b925 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:30.393387 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce736097-49e7-4684-bcfc-63987373b925 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:30.393911 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce736097-49e7-4684-bcfc-63987373b925 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:30.394587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce736097-49e7-4684-bcfc-63987373b925 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:30.395173 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce736097-49e7-4684-bcfc-63987373b925 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:30.395782 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce736097-49e7-4684-bcfc-63987373b925 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:30.396210 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ce736097-49e7-4684-bcfc-63987373b925 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:30.532277 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ce736097-49e7-4684-bcfc-63987373b925 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:30.541804 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-ce736097-49e7-4684-bcfc-63987373b925 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1367 microversion: 2.1 time: 0.159085 Aug 24 12:37:30.545078 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 308/612] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:30 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:31.130170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8c9ae138-caa8-4bf3-ad37-9f33b7457674 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:31.132148 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8c9ae138-caa8-4bf3-ad37-9f33b7457674 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:31.141695 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c9ae138-caa8-4bf3-ad37-9f33b7457674 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:31.143196 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c9ae138-caa8-4bf3-ad37-9f33b7457674 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:31.144216 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c9ae138-caa8-4bf3-ad37-9f33b7457674 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:31.145673 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c9ae138-caa8-4bf3-ad37-9f33b7457674 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:31.146798 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c9ae138-caa8-4bf3-ad37-9f33b7457674 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:31.147957 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c9ae138-caa8-4bf3-ad37-9f33b7457674 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:31.303037 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8c9ae138-caa8-4bf3-ad37-9f33b7457674 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:31.311432 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8c9ae138-caa8-4bf3-ad37-9f33b7457674 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1295 microversion: 2.1 time: 0.186636 Aug 24 12:37:31.312130 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 305/613] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:31 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1295 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:31.566150 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-24473bd2-b486-4c1a-b358-8c2a75929706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:31.568613 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-24473bd2-b486-4c1a-b358-8c2a75929706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:31.581511 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-24473bd2-b486-4c1a-b358-8c2a75929706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:31.585390 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-24473bd2-b486-4c1a-b358-8c2a75929706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:31.586114 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-24473bd2-b486-4c1a-b358-8c2a75929706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:31.587591 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-24473bd2-b486-4c1a-b358-8c2a75929706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:31.588236 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-24473bd2-b486-4c1a-b358-8c2a75929706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:31.589345 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-24473bd2-b486-4c1a-b358-8c2a75929706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:31.875881 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-24473bd2-b486-4c1a-b358-8c2a75929706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:31.887310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-24473bd2-b486-4c1a-b358-8c2a75929706 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1367 microversion: 2.1 time: 0.324403 Aug 24 12:37:31.888275 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 309/614] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:31 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:32.074261 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-acf70849-6bd8-4fc8-aa29-4c7bad142502 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:32.075112 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-acf70849-6bd8-4fc8-aa29-4c7bad142502 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:32.093237 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-acf70849-6bd8-4fc8-aa29-4c7bad142502 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.093767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-acf70849-6bd8-4fc8-aa29-4c7bad142502 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.094199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-acf70849-6bd8-4fc8-aa29-4c7bad142502 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.094905 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-acf70849-6bd8-4fc8-aa29-4c7bad142502 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.095356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-acf70849-6bd8-4fc8-aa29-4c7bad142502 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.095804 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-acf70849-6bd8-4fc8-aa29-4c7bad142502 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.142599 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.objects.instance [None req-acf70849-6bd8-4fc8-aa29-4c7bad142502 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lazy-loading 'flavor' on Instance uuid cec78743-6cd7-4df3-a22c-72acff29cf1a {{(pid=127307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:37:32.334319 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-db249608-8391-40e7-889f-5d90e1319adf tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:32.334962 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-db249608-8391-40e7-889f-5d90e1319adf tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:32.343884 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db249608-8391-40e7-889f-5d90e1319adf tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.348059 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db249608-8391-40e7-889f-5d90e1319adf tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.349923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db249608-8391-40e7-889f-5d90e1319adf tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.350805 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db249608-8391-40e7-889f-5d90e1319adf tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.353002 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db249608-8391-40e7-889f-5d90e1319adf tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.353533 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db249608-8391-40e7-889f-5d90e1319adf tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.418298 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-acf70849-6bd8-4fc8-aa29-4c7bad142502 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "POST /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a/action" status: 202 len: 0 microversion: 2.20 time: 0.347271 Aug 24 12:37:32.419060 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 306/615] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 12:37:32 2022] POST /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:37:32.427825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-05b02759-8274-4a2a-ae13-b933f82417d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:32.428852 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-05b02759-8274-4a2a-ae13-b933f82417d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:32.436475 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05b02759-8274-4a2a-ae13-b933f82417d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.437236 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05b02759-8274-4a2a-ae13-b933f82417d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.438012 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05b02759-8274-4a2a-ae13-b933f82417d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.438964 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05b02759-8274-4a2a-ae13-b933f82417d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.439584 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05b02759-8274-4a2a-ae13-b933f82417d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.440236 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05b02759-8274-4a2a-ae13-b933f82417d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.723264 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-db249608-8391-40e7-889f-5d90e1319adf tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:32.732932 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-db249608-8391-40e7-889f-5d90e1319adf tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1362 microversion: 2.1 time: 0.402364 Aug 24 12:37:32.733534 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 310/616] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:32 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:37:32.764135 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-05b02759-8274-4a2a-ae13-b933f82417d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:32.775842 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-05b02759-8274-4a2a-ae13-b933f82417d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:32.778222 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-05b02759-8274-4a2a-ae13-b933f82417d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:32.779480 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-05b02759-8274-4a2a-ae13-b933f82417d4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1718 microversion: 2.20 time: 0.356043 Aug 24 12:37:32.780068 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 307/617] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:32 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1718 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:32.859975 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-1bf0ec20-fb6a-41ec-a5fa-f0a1669521ca req-8469c808-b638-49de-b851-55fd4fc35f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43372cd4-ec10-4467-a0e3-c7b1d44dc50e", "tag": "ba766c95-3ec9-4202-a80a-fc2559e0bdfb"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:32.871935 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-1bf0ec20-fb6a-41ec-a5fa-f0a1669521ca req-8469c808-b638-49de-b851-55fd4fc35f36 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.872757 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-1bf0ec20-fb6a-41ec-a5fa-f0a1669521ca req-8469c808-b638-49de-b851-55fd4fc35f36 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.873246 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-1bf0ec20-fb6a-41ec-a5fa-f0a1669521ca req-8469c808-b638-49de-b851-55fd4fc35f36 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.901999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-1bf0ec20-fb6a-41ec-a5fa-f0a1669521ca req-8469c808-b638-49de-b851-55fd4fc35f36 service nova] Creating event network-changed:ba766c95-3ec9-4202-a80a-fc2559e0bdfb for instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e on hv-cinder-84890 Aug 24 12:37:32.907981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8db69a2e-7603-4190-85a1-b76361c72372 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:32.908728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-1bf0ec20-fb6a-41ec-a5fa-f0a1669521ca req-8469c808-b638-49de-b851-55fd4fc35f36 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053740 Aug 24 12:37:32.908920 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8db69a2e-7603-4190-85a1-b76361c72372 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:32.909638 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 311/618] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:32.914954 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8db69a2e-7603-4190-85a1-b76361c72372 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.915438 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8db69a2e-7603-4190-85a1-b76361c72372 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.915907 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8db69a2e-7603-4190-85a1-b76361c72372 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.916600 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8db69a2e-7603-4190-85a1-b76361c72372 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.917228 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8db69a2e-7603-4190-85a1-b76361c72372 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.917684 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8db69a2e-7603-4190-85a1-b76361c72372 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:33.188952 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8db69a2e-7603-4190-85a1-b76361c72372 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:33.198257 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8db69a2e-7603-4190-85a1-b76361c72372 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1367 microversion: 2.1 time: 0.293885 Aug 24 12:37:33.199440 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 308/619] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:32 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:33.199728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-bdd8e321-32d7-4102-91ea-39ec20cc7eb0 req-c4e4d16e-36ab-452d-8b6a-3a6b6fe8d425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812d57c7-7fbf-4d11-bc76-a23e9ae9f394", "name": "network-vif-plugged", "status": "completed", "tag": "10113451-b2c5-4e51-a5e5-9b48dbc8798e"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:33.221170 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-bdd8e321-32d7-4102-91ea-39ec20cc7eb0 req-c4e4d16e-36ab-452d-8b6a-3a6b6fe8d425 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:33.221971 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-bdd8e321-32d7-4102-91ea-39ec20cc7eb0 req-c4e4d16e-36ab-452d-8b6a-3a6b6fe8d425 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:33.222616 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-bdd8e321-32d7-4102-91ea-39ec20cc7eb0 req-c4e4d16e-36ab-452d-8b6a-3a6b6fe8d425 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:33.227097 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:33.239375 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-bdd8e321-32d7-4102-91ea-39ec20cc7eb0 req-c4e4d16e-36ab-452d-8b6a-3a6b6fe8d425 service nova] Creating event network-vif-plugged:10113451-b2c5-4e51-a5e5-9b48dbc8798e for instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 on hv-cinder-84890 Aug 24 12:37:33.245545 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-bdd8e321-32d7-4102-91ea-39ec20cc7eb0 req-c4e4d16e-36ab-452d-8b6a-3a6b6fe8d425 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053016 Aug 24 12:37:33.247714 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 312/620] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:33.756192 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0e7aae17-0d13-4564-9025-0eefcc0dd053 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:33.756815 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0e7aae17-0d13-4564-9025-0eefcc0dd053 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:33.763291 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0e7aae17-0d13-4564-9025-0eefcc0dd053 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:33.763899 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0e7aae17-0d13-4564-9025-0eefcc0dd053 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:33.764561 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0e7aae17-0d13-4564-9025-0eefcc0dd053 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:33.765554 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0e7aae17-0d13-4564-9025-0eefcc0dd053 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:33.766092 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0e7aae17-0d13-4564-9025-0eefcc0dd053 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:33.766425 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0e7aae17-0d13-4564-9025-0eefcc0dd053 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:33.803775 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-3fab1fbe-05b6-43e3-8261-da550eb6aaf8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:33.813962 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-3fab1fbe-05b6-43e3-8261-da550eb6aaf8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:33.822762 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3fab1fbe-05b6-43e3-8261-da550eb6aaf8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:33.823611 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3fab1fbe-05b6-43e3-8261-da550eb6aaf8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:33.824437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3fab1fbe-05b6-43e3-8261-da550eb6aaf8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:33.828318 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3fab1fbe-05b6-43e3-8261-da550eb6aaf8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:33.829072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3fab1fbe-05b6-43e3-8261-da550eb6aaf8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:33.829720 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3fab1fbe-05b6-43e3-8261-da550eb6aaf8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:34.014172 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-0e7aae17-0d13-4564-9025-0eefcc0dd053 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:34.020545 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0e7aae17-0d13-4564-9025-0eefcc0dd053 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1362 microversion: 2.1 time: 0.269418 Aug 24 12:37:34.021196 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 309/621] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:33 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:34.039084 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-3fab1fbe-05b6-43e3-8261-da550eb6aaf8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:34.048713 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-3fab1fbe-05b6-43e3-8261-da550eb6aaf8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:34.050303 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-3fab1fbe-05b6-43e3-8261-da550eb6aaf8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:34.051565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-3fab1fbe-05b6-43e3-8261-da550eb6aaf8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1718 microversion: 2.20 time: 0.252403 Aug 24 12:37:34.052311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 313/622] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:33 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1718 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:34.221906 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ab43f407-5507-4266-8684-c649a6c1d88e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:34.222537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ab43f407-5507-4266-8684-c649a6c1d88e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:34.232152 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ab43f407-5507-4266-8684-c649a6c1d88e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:34.232697 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ab43f407-5507-4266-8684-c649a6c1d88e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:34.233333 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ab43f407-5507-4266-8684-c649a6c1d88e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:34.234119 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ab43f407-5507-4266-8684-c649a6c1d88e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:34.234609 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ab43f407-5507-4266-8684-c649a6c1d88e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:34.235032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ab43f407-5507-4266-8684-c649a6c1d88e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:34.458299 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ab43f407-5507-4266-8684-c649a6c1d88e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:34.466194 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ab43f407-5507-4266-8684-c649a6c1d88e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1367 microversion: 2.1 time: 0.248943 Aug 24 12:37:34.466767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 310/623] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:34 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:35.048316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-36bdff37-f37b-4ed7-8d75-4f954e8651cb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:35.052999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-36bdff37-f37b-4ed7-8d75-4f954e8651cb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:35.060783 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-36bdff37-f37b-4ed7-8d75-4f954e8651cb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:35.061573 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-36bdff37-f37b-4ed7-8d75-4f954e8651cb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:35.062742 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-36bdff37-f37b-4ed7-8d75-4f954e8651cb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:35.064373 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-36bdff37-f37b-4ed7-8d75-4f954e8651cb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:35.065486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-36bdff37-f37b-4ed7-8d75-4f954e8651cb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:35.066072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-36bdff37-f37b-4ed7-8d75-4f954e8651cb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:35.076543 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5be5a13d-c9ee-4aef-a236-cd089abf0d12 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:35.078128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5be5a13d-c9ee-4aef-a236-cd089abf0d12 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:35.092543 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5be5a13d-c9ee-4aef-a236-cd089abf0d12 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:35.094816 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5be5a13d-c9ee-4aef-a236-cd089abf0d12 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:35.095269 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5be5a13d-c9ee-4aef-a236-cd089abf0d12 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:35.097917 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5be5a13d-c9ee-4aef-a236-cd089abf0d12 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:35.099655 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5be5a13d-c9ee-4aef-a236-cd089abf0d12 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:35.100114 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5be5a13d-c9ee-4aef-a236-cd089abf0d12 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:35.318134 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-36bdff37-f37b-4ed7-8d75-4f954e8651cb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:35.328424 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-36bdff37-f37b-4ed7-8d75-4f954e8651cb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1362 microversion: 2.1 time: 0.290733 Aug 24 12:37:35.332061 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 314/624] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:35 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:35.348240 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5be5a13d-c9ee-4aef-a236-cd089abf0d12 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:35.356494 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5be5a13d-c9ee-4aef-a236-cd089abf0d12 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:35.357992 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5be5a13d-c9ee-4aef-a236-cd089abf0d12 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:35.359150 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5be5a13d-c9ee-4aef-a236-cd089abf0d12 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1718 microversion: 2.20 time: 0.288764 Aug 24 12:37:35.359746 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 311/625] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:35 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1718 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:35.487825 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-22d08f5d-15c2-4f7c-b0d4-23a6cd24412f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:35.489191 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-22d08f5d-15c2-4f7c-b0d4-23a6cd24412f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:35.497869 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-22d08f5d-15c2-4f7c-b0d4-23a6cd24412f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:35.498812 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-22d08f5d-15c2-4f7c-b0d4-23a6cd24412f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:35.499499 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-22d08f5d-15c2-4f7c-b0d4-23a6cd24412f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:35.500659 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-22d08f5d-15c2-4f7c-b0d4-23a6cd24412f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:35.501471 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-22d08f5d-15c2-4f7c-b0d4-23a6cd24412f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:35.502113 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-22d08f5d-15c2-4f7c-b0d4-23a6cd24412f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:35.672202 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-22d08f5d-15c2-4f7c-b0d4-23a6cd24412f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:35.679753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-22d08f5d-15c2-4f7c-b0d4-23a6cd24412f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1367 microversion: 2.1 time: 0.196608 Aug 24 12:37:35.680319 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 315/626] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:35 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:36.349808 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f7099b6a-7b76-4161-b70e-62fa3ee8d7a6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:36.350532 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f7099b6a-7b76-4161-b70e-62fa3ee8d7a6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:36.357904 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f7099b6a-7b76-4161-b70e-62fa3ee8d7a6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:36.358464 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f7099b6a-7b76-4161-b70e-62fa3ee8d7a6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:36.358963 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f7099b6a-7b76-4161-b70e-62fa3ee8d7a6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:36.359764 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f7099b6a-7b76-4161-b70e-62fa3ee8d7a6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:36.360290 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f7099b6a-7b76-4161-b70e-62fa3ee8d7a6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:36.360799 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f7099b6a-7b76-4161-b70e-62fa3ee8d7a6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:36.389533 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-166f88d4-10f8-4308-8b8f-da36d507df18 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:36.390721 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-166f88d4-10f8-4308-8b8f-da36d507df18 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:36.396828 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-166f88d4-10f8-4308-8b8f-da36d507df18 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:36.397311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-166f88d4-10f8-4308-8b8f-da36d507df18 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:36.397740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-166f88d4-10f8-4308-8b8f-da36d507df18 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:36.398430 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-166f88d4-10f8-4308-8b8f-da36d507df18 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:36.398872 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-166f88d4-10f8-4308-8b8f-da36d507df18 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:36.399283 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-166f88d4-10f8-4308-8b8f-da36d507df18 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:36.570593 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f7099b6a-7b76-4161-b70e-62fa3ee8d7a6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:36.579823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f7099b6a-7b76-4161-b70e-62fa3ee8d7a6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1362 microversion: 2.1 time: 0.234155 Aug 24 12:37:36.581162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 312/627] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:36 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:36.587066 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-166f88d4-10f8-4308-8b8f-da36d507df18 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:36.597556 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-166f88d4-10f8-4308-8b8f-da36d507df18 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:36.599202 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-166f88d4-10f8-4308-8b8f-da36d507df18 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:36.600489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-166f88d4-10f8-4308-8b8f-da36d507df18 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1718 microversion: 2.20 time: 0.221321 Aug 24 12:37:36.601134 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 316/628] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:36 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1718 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:36.702035 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-4687a893-feea-4286-95b7-4df7cd8b2b06 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:36.702657 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-4687a893-feea-4286-95b7-4df7cd8b2b06 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:36.708734 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4687a893-feea-4286-95b7-4df7cd8b2b06 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:36.709227 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4687a893-feea-4286-95b7-4df7cd8b2b06 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:36.709666 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4687a893-feea-4286-95b7-4df7cd8b2b06 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:36.710783 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4687a893-feea-4286-95b7-4df7cd8b2b06 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:36.711293 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4687a893-feea-4286-95b7-4df7cd8b2b06 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:36.711750 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4687a893-feea-4286-95b7-4df7cd8b2b06 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:36.874291 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-4687a893-feea-4286-95b7-4df7cd8b2b06 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:36.884157 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-4687a893-feea-4286-95b7-4df7cd8b2b06 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1557 microversion: 2.1 time: 0.186950 Aug 24 12:37:36.886876 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 313/629] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:36 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1557 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:36.908131 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a9cb54d0-ae3a-426f-ae18-1a89504ad6ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:36.908628 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-a9cb54d0-ae3a-426f-ae18-1a89504ad6ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:36.914548 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a9cb54d0-ae3a-426f-ae18-1a89504ad6ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:36.915035 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a9cb54d0-ae3a-426f-ae18-1a89504ad6ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:36.915744 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a9cb54d0-ae3a-426f-ae18-1a89504ad6ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:36.916442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a9cb54d0-ae3a-426f-ae18-1a89504ad6ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:36.917056 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a9cb54d0-ae3a-426f-ae18-1a89504ad6ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:36.917807 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a9cb54d0-ae3a-426f-ae18-1a89504ad6ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:37.004314 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a9cb54d0-ae3a-426f-ae18-1a89504ad6ae tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099782 Aug 24 12:37:37.005397 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 317/630] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 12:37:36 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:37.187868 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-5f1cd0ae-a02b-4068-865b-b13964ec83aa req-e3475786-a97f-4cec-ad85-ba502cdb4596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43372cd4-ec10-4467-a0e3-c7b1d44dc50e", "name": "network-vif-plugged", "status": "completed", "tag": "ba766c95-3ec9-4202-a80a-fc2559e0bdfb"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:37.200492 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-5f1cd0ae-a02b-4068-865b-b13964ec83aa req-e3475786-a97f-4cec-ad85-ba502cdb4596 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:37.201630 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-5f1cd0ae-a02b-4068-865b-b13964ec83aa req-e3475786-a97f-4cec-ad85-ba502cdb4596 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:37.202471 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-5f1cd0ae-a02b-4068-865b-b13964ec83aa req-e3475786-a97f-4cec-ad85-ba502cdb4596 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:37.217495 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-5f1cd0ae-a02b-4068-865b-b13964ec83aa req-e3475786-a97f-4cec-ad85-ba502cdb4596 service nova] Creating event network-vif-plugged:ba766c95-3ec9-4202-a80a-fc2559e0bdfb for instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e on hv-cinder-84890 Aug 24 12:37:37.226946 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-5f1cd0ae-a02b-4068-865b-b13964ec83aa req-e3475786-a97f-4cec-ad85-ba502cdb4596 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043180 Aug 24 12:37:37.228802 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 314/631] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:37.866808 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-5f8284c0-7d85-419c-83ba-8457af01868b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:37.867593 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-5f8284c0-7d85-419c-83ba-8457af01868b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:37.876897 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5f8284c0-7d85-419c-83ba-8457af01868b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:37.877717 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5f8284c0-7d85-419c-83ba-8457af01868b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:37.881308 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5f8284c0-7d85-419c-83ba-8457af01868b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:37.882420 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5f8284c0-7d85-419c-83ba-8457af01868b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:37.883091 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5f8284c0-7d85-419c-83ba-8457af01868b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:37.883777 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5f8284c0-7d85-419c-83ba-8457af01868b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:37.921934 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b699861c-a82b-4910-98bf-9206ed73f5a2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:37.923805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-b699861c-a82b-4910-98bf-9206ed73f5a2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:37.931954 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b699861c-a82b-4910-98bf-9206ed73f5a2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:37.932451 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b699861c-a82b-4910-98bf-9206ed73f5a2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:37.932883 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b699861c-a82b-4910-98bf-9206ed73f5a2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:37.933612 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b699861c-a82b-4910-98bf-9206ed73f5a2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:37.934279 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b699861c-a82b-4910-98bf-9206ed73f5a2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:37.934730 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b699861c-a82b-4910-98bf-9206ed73f5a2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:38.427508 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-5f8284c0-7d85-419c-83ba-8457af01868b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:38.436581 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-5f8284c0-7d85-419c-83ba-8457af01868b tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1362 microversion: 2.1 time: 0.834073 Aug 24 12:37:38.437613 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 318/632] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:37 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1362 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:38.439248 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b699861c-a82b-4910-98bf-9206ed73f5a2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:38.452283 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b699861c-a82b-4910-98bf-9206ed73f5a2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:38.458579 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b699861c-a82b-4910-98bf-9206ed73f5a2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:38.460083 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b699861c-a82b-4910-98bf-9206ed73f5a2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1718 microversion: 2.20 time: 0.837461 Aug 24 12:37:38.460999 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 315/633] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:37 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1718 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:37:38.511279 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-cd0da9be-82b7-4480-a055-27a9a71a1db8 req-e218dde3-3b96-4aa9-8289-bb41815743ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "812d57c7-7fbf-4d11-bc76-a23e9ae9f394", "tag": "10113451-b2c5-4e51-a5e5-9b48dbc8798e"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:38.520736 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-cd0da9be-82b7-4480-a055-27a9a71a1db8 req-e218dde3-3b96-4aa9-8289-bb41815743ee service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:38.521355 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-cd0da9be-82b7-4480-a055-27a9a71a1db8 req-e218dde3-3b96-4aa9-8289-bb41815743ee service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:38.521705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-cd0da9be-82b7-4480-a055-27a9a71a1db8 req-e218dde3-3b96-4aa9-8289-bb41815743ee service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:38.534079 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-cd0da9be-82b7-4480-a055-27a9a71a1db8 req-e218dde3-3b96-4aa9-8289-bb41815743ee service nova] Creating event network-changed:10113451-b2c5-4e51-a5e5-9b48dbc8798e for instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 on hv-cinder-84890 Aug 24 12:37:38.543378 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-cd0da9be-82b7-4480-a055-27a9a71a1db8 req-e218dde3-3b96-4aa9-8289-bb41815743ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035071 Aug 24 12:37:38.544346 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 319/634] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:39.457913 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8887463d-4a8b-4b10-9702-f6e2390d7971 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:39.458529 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8887463d-4a8b-4b10-9702-f6e2390d7971 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:39.467284 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=10 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:39.470781 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8887463d-4a8b-4b10-9702-f6e2390d7971 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:39.472138 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8887463d-4a8b-4b10-9702-f6e2390d7971 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:39.472801 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8887463d-4a8b-4b10-9702-f6e2390d7971 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:39.473736 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8887463d-4a8b-4b10-9702-f6e2390d7971 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:39.474205 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8887463d-4a8b-4b10-9702-f6e2390d7971 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:39.474633 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8887463d-4a8b-4b10-9702-f6e2390d7971 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:39.485061 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ccd96532-cb6b-4426-85f8-959c775e5885 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:39.486817 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-ccd96532-cb6b-4426-85f8-959c775e5885 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:39.489923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=4 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:39.490753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=14 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:39.496833 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ccd96532-cb6b-4426-85f8-959c775e5885 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:39.497393 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ccd96532-cb6b-4426-85f8-959c775e5885 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:39.497825 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ccd96532-cb6b-4426-85f8-959c775e5885 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:39.499042 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ccd96532-cb6b-4426-85f8-959c775e5885 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:39.499042 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ccd96532-cb6b-4426-85f8-959c775e5885 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:39.499361 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ccd96532-cb6b-4426-85f8-959c775e5885 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:39.502260 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:39.779929 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8887463d-4a8b-4b10-9702-f6e2390d7971 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:39.790538 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8887463d-4a8b-4b10-9702-f6e2390d7971 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1549 microversion: 2.1 time: 0.336330 Aug 24 12:37:39.791390 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 316/635] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:39 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1549 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:39.814045 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d0aa6bce-e8f6-4b8f-812a-a21cc09ab1d3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:39.818225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ccd96532-cb6b-4426-85f8-959c775e5885 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:39.819897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d0aa6bce-e8f6-4b8f-812a-a21cc09ab1d3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:39.827330 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ccd96532-cb6b-4426-85f8-959c775e5885 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:39.827534 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d0aa6bce-e8f6-4b8f-812a-a21cc09ab1d3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:39.827990 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d0aa6bce-e8f6-4b8f-812a-a21cc09ab1d3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:39.828462 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d0aa6bce-e8f6-4b8f-812a-a21cc09ab1d3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:39.829198 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d0aa6bce-e8f6-4b8f-812a-a21cc09ab1d3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:39.829479 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ccd96532-cb6b-4426-85f8-959c775e5885 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:39.829656 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d0aa6bce-e8f6-4b8f-812a-a21cc09ab1d3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:39.830280 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d0aa6bce-e8f6-4b8f-812a-a21cc09ab1d3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:39.830986 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-ccd96532-cb6b-4426-85f8-959c775e5885 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1718 microversion: 2.20 time: 0.351172 Aug 24 12:37:39.831769 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 320/636] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:39 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1718 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:39.934859 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d0aa6bce-e8f6-4b8f-812a-a21cc09ab1d3 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125990 Aug 24 12:37:39.935671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 317/637] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 12:37:39 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:37:40.858958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7340364c-d9f9-4260-ab88-a2700aa9c7a5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:40.859548 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-7340364c-d9f9-4260-ab88-a2700aa9c7a5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:40.865924 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7340364c-d9f9-4260-ab88-a2700aa9c7a5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:40.866410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7340364c-d9f9-4260-ab88-a2700aa9c7a5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:40.866849 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7340364c-d9f9-4260-ab88-a2700aa9c7a5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:40.867541 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7340364c-d9f9-4260-ab88-a2700aa9c7a5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:40.868013 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7340364c-d9f9-4260-ab88-a2700aa9c7a5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:40.868436 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7340364c-d9f9-4260-ab88-a2700aa9c7a5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:40.901253 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-0a90a396-5eb4-4b2f-b66f-9ba2e7f84b0d req-9bb5258e-f8e9-4dd2-9327-085e418b4d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43372cd4-ec10-4467-a0e3-c7b1d44dc50e", "tag": "ba766c95-3ec9-4202-a80a-fc2559e0bdfb"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:40.911119 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-0a90a396-5eb4-4b2f-b66f-9ba2e7f84b0d req-9bb5258e-f8e9-4dd2-9327-085e418b4d25 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:40.911958 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-0a90a396-5eb4-4b2f-b66f-9ba2e7f84b0d req-9bb5258e-f8e9-4dd2-9327-085e418b4d25 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:40.912626 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-0a90a396-5eb4-4b2f-b66f-9ba2e7f84b0d req-9bb5258e-f8e9-4dd2-9327-085e418b4d25 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:40.927824 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-0a90a396-5eb4-4b2f-b66f-9ba2e7f84b0d req-9bb5258e-f8e9-4dd2-9327-085e418b4d25 service nova] Creating event network-changed:ba766c95-3ec9-4202-a80a-fc2559e0bdfb for instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e on hv-cinder-84890 Aug 24 12:37:40.933710 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-0a90a396-5eb4-4b2f-b66f-9ba2e7f84b0d req-9bb5258e-f8e9-4dd2-9327-085e418b4d25 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035951 Aug 24 12:37:40.934419 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 318/638] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:37:41.136924 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-7340364c-d9f9-4260-ab88-a2700aa9c7a5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:41.145860 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-7340364c-d9f9-4260-ab88-a2700aa9c7a5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:41.147664 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-7340364c-d9f9-4260-ab88-a2700aa9c7a5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:41.148906 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-7340364c-d9f9-4260-ab88-a2700aa9c7a5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1718 microversion: 2.20 time: 0.294460 Aug 24 12:37:41.149476 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 321/639] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:40 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1718 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:42.174251 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-226946b2-a162-4c18-abc1-88ee6b10364d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:42.174976 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-226946b2-a162-4c18-abc1-88ee6b10364d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:42.181268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-226946b2-a162-4c18-abc1-88ee6b10364d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:42.181943 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-226946b2-a162-4c18-abc1-88ee6b10364d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:42.182400 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-226946b2-a162-4c18-abc1-88ee6b10364d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:42.183256 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-226946b2-a162-4c18-abc1-88ee6b10364d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:42.183812 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-226946b2-a162-4c18-abc1-88ee6b10364d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:42.184562 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-226946b2-a162-4c18-abc1-88ee6b10364d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:42.325200 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-226946b2-a162-4c18-abc1-88ee6b10364d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:42.334700 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-226946b2-a162-4c18-abc1-88ee6b10364d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:42.336344 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-226946b2-a162-4c18-abc1-88ee6b10364d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:42.337515 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-226946b2-a162-4c18-abc1-88ee6b10364d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1718 microversion: 2.20 time: 0.169225 Aug 24 12:37:42.338068 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 319/640] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:42 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1718 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:42.886455 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-8d156a2f-5acc-4586-8092-b825c19e21c9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:42.888091 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-8d156a2f-5acc-4586-8092-b825c19e21c9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:42.894944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8d156a2f-5acc-4586-8092-b825c19e21c9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:42.895438 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8d156a2f-5acc-4586-8092-b825c19e21c9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:42.895895 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8d156a2f-5acc-4586-8092-b825c19e21c9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:42.896588 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8d156a2f-5acc-4586-8092-b825c19e21c9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:42.897035 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8d156a2f-5acc-4586-8092-b825c19e21c9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:42.897451 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8d156a2f-5acc-4586-8092-b825c19e21c9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:42.922316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-8d156a2f-5acc-4586-8092-b825c19e21c9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Going to try to terminate instance {{(pid=127308) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:37:42.999778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-8d156a2f-5acc-4586-8092-b825c19e21c9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 204 len: 0 microversion: 2.1 time: 0.116755 Aug 24 12:37:43.000617 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 322/641] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:37:42 2022] DELETE /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:37:43.008901 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f453a270-c9dd-4035-a1fc-7f9ad94b93fd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:43.009607 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f453a270-c9dd-4035-a1fc-7f9ad94b93fd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:43.015747 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f453a270-c9dd-4035-a1fc-7f9ad94b93fd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:43.016299 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f453a270-c9dd-4035-a1fc-7f9ad94b93fd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:43.016799 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f453a270-c9dd-4035-a1fc-7f9ad94b93fd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:43.017547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f453a270-c9dd-4035-a1fc-7f9ad94b93fd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:43.018003 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f453a270-c9dd-4035-a1fc-7f9ad94b93fd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:43.018521 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f453a270-c9dd-4035-a1fc-7f9ad94b93fd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:43.154800 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f453a270-c9dd-4035-a1fc-7f9ad94b93fd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:43.162610 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f453a270-c9dd-4035-a1fc-7f9ad94b93fd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1578 microversion: 2.1 time: 0.157609 Aug 24 12:37:43.163168 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 320/642] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:43 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:43.363321 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-36e56c3b-9350-432f-a561-3ba3c0a2c4f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:43.364060 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-36e56c3b-9350-432f-a561-3ba3c0a2c4f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:43.369917 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-36e56c3b-9350-432f-a561-3ba3c0a2c4f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:43.370400 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-36e56c3b-9350-432f-a561-3ba3c0a2c4f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:43.370831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-36e56c3b-9350-432f-a561-3ba3c0a2c4f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:43.371558 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-36e56c3b-9350-432f-a561-3ba3c0a2c4f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:43.372097 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-36e56c3b-9350-432f-a561-3ba3c0a2c4f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:43.372551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-36e56c3b-9350-432f-a561-3ba3c0a2c4f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:43.506408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-36e56c3b-9350-432f-a561-3ba3c0a2c4f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:43.515046 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-36e56c3b-9350-432f-a561-3ba3c0a2c4f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:43.516560 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-36e56c3b-9350-432f-a561-3ba3c0a2c4f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:43.517737 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-36e56c3b-9350-432f-a561-3ba3c0a2c4f7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1718 microversion: 2.20 time: 0.158703 Aug 24 12:37:43.518289 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 323/643] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:43 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:37:44.185439 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-67d73017-27a6-4ba0-9f42-3bfa0374eba1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:44.186108 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-67d73017-27a6-4ba0-9f42-3bfa0374eba1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:44.192527 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67d73017-27a6-4ba0-9f42-3bfa0374eba1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:44.193004 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67d73017-27a6-4ba0-9f42-3bfa0374eba1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:44.193433 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67d73017-27a6-4ba0-9f42-3bfa0374eba1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:44.194106 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67d73017-27a6-4ba0-9f42-3bfa0374eba1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:44.194550 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67d73017-27a6-4ba0-9f42-3bfa0374eba1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:44.194964 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-67d73017-27a6-4ba0-9f42-3bfa0374eba1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:44.330670 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-67d73017-27a6-4ba0-9f42-3bfa0374eba1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:44.338602 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-67d73017-27a6-4ba0-9f42-3bfa0374eba1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1578 microversion: 2.1 time: 0.156981 Aug 24 12:37:44.339333 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 321/644] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:44 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:44.540663 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-110bb9be-d37c-46ac-800f-c469d862054a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:44.541230 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-110bb9be-d37c-46ac-800f-c469d862054a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:44.547643 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-110bb9be-d37c-46ac-800f-c469d862054a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:44.548128 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-110bb9be-d37c-46ac-800f-c469d862054a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:44.548563 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-110bb9be-d37c-46ac-800f-c469d862054a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:44.549246 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-110bb9be-d37c-46ac-800f-c469d862054a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:44.549694 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-110bb9be-d37c-46ac-800f-c469d862054a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:44.550113 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-110bb9be-d37c-46ac-800f-c469d862054a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:44.682777 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-110bb9be-d37c-46ac-800f-c469d862054a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:44.690898 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-110bb9be-d37c-46ac-800f-c469d862054a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:44.692420 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-110bb9be-d37c-46ac-800f-c469d862054a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:44.693573 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-110bb9be-d37c-46ac-800f-c469d862054a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1718 microversion: 2.20 time: 0.156866 Aug 24 12:37:44.694130 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 324/645] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:44 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:37:45.362984 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6804c846-d7e6-4201-a9e6-a28f96b2963d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:45.364591 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-6804c846-d7e6-4201-a9e6-a28f96b2963d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:45.371412 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6804c846-d7e6-4201-a9e6-a28f96b2963d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:45.371939 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6804c846-d7e6-4201-a9e6-a28f96b2963d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:45.372370 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6804c846-d7e6-4201-a9e6-a28f96b2963d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:45.373171 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6804c846-d7e6-4201-a9e6-a28f96b2963d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:45.374138 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6804c846-d7e6-4201-a9e6-a28f96b2963d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:45.374551 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6804c846-d7e6-4201-a9e6-a28f96b2963d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:45.716597 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c300da4d-6acb-486b-8806-4ef6d05012bb tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:45.717676 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c300da4d-6acb-486b-8806-4ef6d05012bb tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:45.724341 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c300da4d-6acb-486b-8806-4ef6d05012bb tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:45.724832 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c300da4d-6acb-486b-8806-4ef6d05012bb tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:45.725268 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c300da4d-6acb-486b-8806-4ef6d05012bb tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:45.725974 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c300da4d-6acb-486b-8806-4ef6d05012bb tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:45.726427 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c300da4d-6acb-486b-8806-4ef6d05012bb tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:45.726850 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c300da4d-6acb-486b-8806-4ef6d05012bb tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:45.907905 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6804c846-d7e6-4201-a9e6-a28f96b2963d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:45.917356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-6804c846-d7e6-4201-a9e6-a28f96b2963d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 200 len: 1578 microversion: 2.1 time: 0.558434 Aug 24 12:37:45.921290 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 322/646] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:45 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 1578 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:45.978849 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c300da4d-6acb-486b-8806-4ef6d05012bb tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:45.987798 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c300da4d-6acb-486b-8806-4ef6d05012bb tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:45.989434 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c300da4d-6acb-486b-8806-4ef6d05012bb tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:45.990591 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c300da4d-6acb-486b-8806-4ef6d05012bb tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1718 microversion: 2.20 time: 0.278098 Aug 24 12:37:45.991143 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 325/647] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:45 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1718 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:37:46.155412 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-b81d9ceb-e681-4091-8b13-56e2e8a9b959 req-333905c6-6d51-46fe-bacf-ca947264af04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab4d787-eab3-4654-8d9c-b7a7f10972ca", "name": "network-vif-deleted", "tag": "0d661b8c-9ce8-4cb3-aeff-26f9ef9ed93e"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:46.167695 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b81d9ceb-e681-4091-8b13-56e2e8a9b959 req-333905c6-6d51-46fe-bacf-ca947264af04 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:46.168521 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b81d9ceb-e681-4091-8b13-56e2e8a9b959 req-333905c6-6d51-46fe-bacf-ca947264af04 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:46.168964 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b81d9ceb-e681-4091-8b13-56e2e8a9b959 req-333905c6-6d51-46fe-bacf-ca947264af04 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:46.184697 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-b81d9ceb-e681-4091-8b13-56e2e8a9b959 req-333905c6-6d51-46fe-bacf-ca947264af04 service nova] Creating event network-vif-deleted:0d661b8c-9ce8-4cb3-aeff-26f9ef9ed93e for instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca on hv-cinder-84890 Aug 24 12:37:46.191788 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-b81d9ceb-e681-4091-8b13-56e2e8a9b959 req-333905c6-6d51-46fe-bacf-ca947264af04 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040600 Aug 24 12:37:46.192390 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 323/648] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:46.941432 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a41ad3fa-0ca6-450f-8110-9d4589c5ddb4 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:46.942050 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-a41ad3fa-0ca6-450f-8110-9d4589c5ddb4 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:46.948844 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a41ad3fa-0ca6-450f-8110-9d4589c5ddb4 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:46.949402 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a41ad3fa-0ca6-450f-8110-9d4589c5ddb4 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:46.952204 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a41ad3fa-0ca6-450f-8110-9d4589c5ddb4 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:46.953006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a41ad3fa-0ca6-450f-8110-9d4589c5ddb4 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:46.953492 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a41ad3fa-0ca6-450f-8110-9d4589c5ddb4 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:46.954033 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a41ad3fa-0ca6-450f-8110-9d4589c5ddb4 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:46.968978 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-a41ad3fa-0ca6-450f-8110-9d4589c5ddb4 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] HTTP exception thrown: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a41ad3fa-0ca6-450f-8110-9d4589c5ddb4 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Request method failure captured: Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca HTTP/1.1 Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhrMbzVlgAJuK48N__SomnhkvQksnaHN-tfYRcQII9klqdSLnHB1qTWELLHRFtO4kr3rSnmywVeDWo8659gOx13imLD8TdicULFr7i0qkvDR5HUfOq15mMSlr-fgao2fZtfPXW5yGh67ifYvboG875k4AepdjEhWjJFvsz9CNdTB6A0 Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: aee96e55a6a34dbb81847961d87abad0 Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-TestVolumeBootPattern-1229545468 Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:37:46.970637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:37:46.972044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:37:46.972044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-TestVolumeBootPattern-1229545468 Aug 24 12:37:46.972044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: aee96e55a6a34dbb81847961d87abad0 Aug 24 12:37:46.972044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229545468 Aug 24 12:37:46.972044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-TestVolumeBootPattern-1229545468-project Aug 24 12:37:46.972044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:37:46.972044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:37:46.972044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 18f8f419b523440f8a4ca06dc83bff40 Aug 24 12:37:46.972044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-TestVolumeBootPattern-1229545468-project Aug 24 12:37:46.972044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:37:46.972044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. Aug 24 12:37:46.972044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '0ab4d787-eab3-4654-8d9c-b7a7f10972ca'} Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:37:46.972831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. Aug 24 12:37:46.974068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:37:46.977009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a41ad3fa-0ca6-450f-8110-9d4589c5ddb4 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Returning 404 to user: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:37:46.977951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a41ad3fa-0ca6-450f-8110-9d4589c5ddb4 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 404 len: 111 microversion: 2.1 time: 0.040370 Aug 24 12:37:46.978510 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 326/649] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:46 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:37:47.015398 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-83fe9550-4b42-40d8-a250-be530c0a1eea tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:47.017184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-83fe9550-4b42-40d8-a250-be530c0a1eea tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:47.024733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-83fe9550-4b42-40d8-a250-be530c0a1eea tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:47.025423 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-83fe9550-4b42-40d8-a250-be530c0a1eea tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:47.025848 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-83fe9550-4b42-40d8-a250-be530c0a1eea tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:47.026692 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-83fe9550-4b42-40d8-a250-be530c0a1eea tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:47.027295 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-83fe9550-4b42-40d8-a250-be530c0a1eea tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:47.027884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-83fe9550-4b42-40d8-a250-be530c0a1eea tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:47.110830 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-445016369", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1946886811", "security_groups": [{"name": "tempest-secgroup-smoke-428063021"}], "block_device_mapping_v2": [{"uuid": "1760b78c-0691-4cb4-af07-9eb2f9544641", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "918842e4-eadb-4db7-819f-681445ef12b9"}]}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:47.194820 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-83fe9550-4b42-40d8-a250-be530c0a1eea tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:47.204203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-83fe9550-4b42-40d8-a250-be530c0a1eea tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:47.205723 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-83fe9550-4b42-40d8-a250-be530c0a1eea tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:47.207139 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-83fe9550-4b42-40d8-a250-be530c0a1eea tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1718 microversion: 2.20 time: 0.196722 Aug 24 12:37:47.207922 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 324/650] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:47 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1718 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:47.245226 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.network.neutron [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] validate_networks() for [('918842e4-eadb-4db7-819f-681445ef12b9', None, None, None, None, None)] {{(pid=127308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:37:47.634123 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Flavor limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:37:47.634541 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Image limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:37:47.635015 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Flavor pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:37:47.635421 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Image pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:37:47.635873 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:37:47.645584 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:47.645996 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:47.646468 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:47.647196 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:47.647671 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:47.648095 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:47.665599 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Getting quotas for project aee96e55a6a34dbb81847961d87abad0. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:37:47.669534 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Getting quotas for user 18f8f419b523440f8a4ca06dc83bff40 and project aee96e55a6a34dbb81847961d87abad0. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:37:47.730609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Going to run 1 instances... {{(pid=127308) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:37:47.732850 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1760b78c-0691-4cb4-af07-9eb2f9544641',volume_size=None,volume_type=None)] {{(pid=127308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:37:47.874885 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-5c2654fb-1d26-46dc-b3ec-60b3b2babfea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.772870 Aug 24 12:37:47.875636 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 327/651] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:37:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 12:37:47.886245 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b8807889-b0cb-40ab-b42f-673ad9e1ce9e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:47.886853 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-b8807889-b0cb-40ab-b42f-673ad9e1ce9e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:47.946197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b8807889-b0cb-40ab-b42f-673ad9e1ce9e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:47.954196 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b8807889-b0cb-40ab-b42f-673ad9e1ce9e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1094 microversion: 2.1 time: 0.071698 Aug 24 12:37:47.954865 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 325/652] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:47 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:48.231999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-21c92a94-e134-4ff6-aa62-e494cd25cba4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:48.233248 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-21c92a94-e134-4ff6-aa62-e494cd25cba4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:48.240978 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-21c92a94-e134-4ff6-aa62-e494cd25cba4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:48.241478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-21c92a94-e134-4ff6-aa62-e494cd25cba4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:48.241914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-21c92a94-e134-4ff6-aa62-e494cd25cba4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:48.242623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-21c92a94-e134-4ff6-aa62-e494cd25cba4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:48.243074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-21c92a94-e134-4ff6-aa62-e494cd25cba4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:48.243499 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-21c92a94-e134-4ff6-aa62-e494cd25cba4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:48.390408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-21c92a94-e134-4ff6-aa62-e494cd25cba4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:48.398795 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-21c92a94-e134-4ff6-aa62-e494cd25cba4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:48.400410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-21c92a94-e134-4ff6-aa62-e494cd25cba4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:48.401555 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-21c92a94-e134-4ff6-aa62-e494cd25cba4 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1739 microversion: 2.20 time: 0.174560 Aug 24 12:37:48.402161 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 328/653] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:48 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:48.974168 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-89ecce7e-9c34-4d4b-ba22-c89d7b82bd91 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:48.974779 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-89ecce7e-9c34-4d4b-ba22-c89d7b82bd91 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:48.981412 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-89ecce7e-9c34-4d4b-ba22-c89d7b82bd91 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:48.981891 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-89ecce7e-9c34-4d4b-ba22-c89d7b82bd91 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:48.982856 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-89ecce7e-9c34-4d4b-ba22-c89d7b82bd91 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:48.983566 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-89ecce7e-9c34-4d4b-ba22-c89d7b82bd91 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:48.984324 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-89ecce7e-9c34-4d4b-ba22-c89d7b82bd91 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:48.984746 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-89ecce7e-9c34-4d4b-ba22-c89d7b82bd91 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:49.090455 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-89ecce7e-9c34-4d4b-ba22-c89d7b82bd91 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:49.102411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-89ecce7e-9c34-4d4b-ba22-c89d7b82bd91 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1200 microversion: 2.1 time: 0.131411 Aug 24 12:37:49.103466 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 326/654] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:48 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1200 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:49.426572 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c51d1c56-dd3c-485b-bc20-64ee4d622403 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:49.428955 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c51d1c56-dd3c-485b-bc20-64ee4d622403 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:49.437718 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c51d1c56-dd3c-485b-bc20-64ee4d622403 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:49.438244 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c51d1c56-dd3c-485b-bc20-64ee4d622403 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:49.438670 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c51d1c56-dd3c-485b-bc20-64ee4d622403 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:49.439793 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c51d1c56-dd3c-485b-bc20-64ee4d622403 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:49.440478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c51d1c56-dd3c-485b-bc20-64ee4d622403 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:49.440895 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c51d1c56-dd3c-485b-bc20-64ee4d622403 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:49.656858 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c51d1c56-dd3c-485b-bc20-64ee4d622403 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:49.666091 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c51d1c56-dd3c-485b-bc20-64ee4d622403 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:49.667647 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c51d1c56-dd3c-485b-bc20-64ee4d622403 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:49.669031 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c51d1c56-dd3c-485b-bc20-64ee4d622403 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1739 microversion: 2.20 time: 0.247336 Aug 24 12:37:49.683655 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 329/655] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:49 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:50.125200 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8aa84963-26b7-4f07-8bd8-446c2382c85d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:50.126033 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8aa84963-26b7-4f07-8bd8-446c2382c85d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:50.133386 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8aa84963-26b7-4f07-8bd8-446c2382c85d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:50.133878 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8aa84963-26b7-4f07-8bd8-446c2382c85d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:50.134497 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8aa84963-26b7-4f07-8bd8-446c2382c85d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:50.135207 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8aa84963-26b7-4f07-8bd8-446c2382c85d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:50.135696 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8aa84963-26b7-4f07-8bd8-446c2382c85d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:50.136128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8aa84963-26b7-4f07-8bd8-446c2382c85d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:50.349086 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8aa84963-26b7-4f07-8bd8-446c2382c85d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:50.357075 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8aa84963-26b7-4f07-8bd8-446c2382c85d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1265 microversion: 2.1 time: 0.236889 Aug 24 12:37:50.358452 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 327/656] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:50 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:50.610547 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-935048d6-a2b6-4f65-85db-85d1a41a472b req-c448eea4-3bdf-4a63-8e19-411449fe7130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee223a9-b84a-4d31-8bd1-a8335fbceff5", "tag": "da346dda-746e-4fae-941a-4376508f9cef"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:50.624147 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-935048d6-a2b6-4f65-85db-85d1a41a472b req-c448eea4-3bdf-4a63-8e19-411449fe7130 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:50.624789 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-935048d6-a2b6-4f65-85db-85d1a41a472b req-c448eea4-3bdf-4a63-8e19-411449fe7130 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:50.625599 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-935048d6-a2b6-4f65-85db-85d1a41a472b req-c448eea4-3bdf-4a63-8e19-411449fe7130 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:50.630019 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:50.644350 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-935048d6-a2b6-4f65-85db-85d1a41a472b req-c448eea4-3bdf-4a63-8e19-411449fe7130 service nova] Creating event network-changed:da346dda-746e-4fae-941a-4376508f9cef for instance cee223a9-b84a-4d31-8bd1-a8335fbceff5 on hv-cinder-84890 Aug 24 12:37:50.650649 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-935048d6-a2b6-4f65-85db-85d1a41a472b req-c448eea4-3bdf-4a63-8e19-411449fe7130 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043627 Aug 24 12:37:50.651492 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 330/657] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:50.692946 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-508448c8-9a4d-4308-9292-7c56d6dc4883 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:50.694067 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-508448c8-9a4d-4308-9292-7c56d6dc4883 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:50.701266 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-508448c8-9a4d-4308-9292-7c56d6dc4883 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:50.701942 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-508448c8-9a4d-4308-9292-7c56d6dc4883 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:50.702370 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-508448c8-9a4d-4308-9292-7c56d6dc4883 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:50.703077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-508448c8-9a4d-4308-9292-7c56d6dc4883 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:50.703529 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-508448c8-9a4d-4308-9292-7c56d6dc4883 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:50.704355 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-508448c8-9a4d-4308-9292-7c56d6dc4883 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:50.931819 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-508448c8-9a4d-4308-9292-7c56d6dc4883 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:50.941151 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-508448c8-9a4d-4308-9292-7c56d6dc4883 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:50.943012 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-508448c8-9a4d-4308-9292-7c56d6dc4883 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:50.944204 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-508448c8-9a4d-4308-9292-7c56d6dc4883 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1734 microversion: 2.20 time: 0.255416 Aug 24 12:37:50.944768 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 328/658] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:50 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1734 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:51.310193 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-38a0e252-4fb7-4bf9-9349-3aa23fdfaffe req-a5def13a-ad13-4afe-8a4d-68b5e4f56953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec78743-6cd7-4df3-a22c-72acff29cf1a", "name": "network-vif-plugged", "status": "completed", "tag": "50ca3644-951e-4983-8b1f-534cdf89c8cb"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:51.324304 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-38a0e252-4fb7-4bf9-9349-3aa23fdfaffe req-a5def13a-ad13-4afe-8a4d-68b5e4f56953 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:51.324786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-38a0e252-4fb7-4bf9-9349-3aa23fdfaffe req-a5def13a-ad13-4afe-8a4d-68b5e4f56953 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:51.325206 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-38a0e252-4fb7-4bf9-9349-3aa23fdfaffe req-a5def13a-ad13-4afe-8a4d-68b5e4f56953 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:51.348784 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-38a0e252-4fb7-4bf9-9349-3aa23fdfaffe req-a5def13a-ad13-4afe-8a4d-68b5e4f56953 service nova] Creating event network-vif-plugged:50ca3644-951e-4983-8b1f-534cdf89c8cb for instance cec78743-6cd7-4df3-a22c-72acff29cf1a on hv-cinder-84890 Aug 24 12:37:51.354281 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-38a0e252-4fb7-4bf9-9349-3aa23fdfaffe req-a5def13a-ad13-4afe-8a4d-68b5e4f56953 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048197 Aug 24 12:37:51.354785 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 331/659] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:51.379527 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c55b5880-a236-47ef-a2c8-4139ea0578c1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:51.380127 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c55b5880-a236-47ef-a2c8-4139ea0578c1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:51.387926 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c55b5880-a236-47ef-a2c8-4139ea0578c1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:51.387926 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c55b5880-a236-47ef-a2c8-4139ea0578c1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:51.388848 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c55b5880-a236-47ef-a2c8-4139ea0578c1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:51.390147 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c55b5880-a236-47ef-a2c8-4139ea0578c1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:51.390841 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c55b5880-a236-47ef-a2c8-4139ea0578c1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:51.391534 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c55b5880-a236-47ef-a2c8-4139ea0578c1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:51.643851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c55b5880-a236-47ef-a2c8-4139ea0578c1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:51.659006 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c55b5880-a236-47ef-a2c8-4139ea0578c1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1265 microversion: 2.1 time: 0.283780 Aug 24 12:37:51.662348 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 329/660] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:51 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:51.972425 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-869e56da-2304-4b29-90c7-8a8d13b1a77e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:51.973994 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-869e56da-2304-4b29-90c7-8a8d13b1a77e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:51.981676 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-869e56da-2304-4b29-90c7-8a8d13b1a77e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:51.982676 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-869e56da-2304-4b29-90c7-8a8d13b1a77e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:51.983416 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-869e56da-2304-4b29-90c7-8a8d13b1a77e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:51.984386 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-869e56da-2304-4b29-90c7-8a8d13b1a77e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:51.985017 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-869e56da-2304-4b29-90c7-8a8d13b1a77e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:51.985603 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-869e56da-2304-4b29-90c7-8a8d13b1a77e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:52.273834 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-869e56da-2304-4b29-90c7-8a8d13b1a77e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:52.284914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-869e56da-2304-4b29-90c7-8a8d13b1a77e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:52.286839 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-869e56da-2304-4b29-90c7-8a8d13b1a77e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:52.288105 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-869e56da-2304-4b29-90c7-8a8d13b1a77e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1734 microversion: 2.20 time: 0.322151 Aug 24 12:37:52.288693 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 332/661] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:51 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1734 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:52.682437 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-102aec86-6ae1-432b-96fd-837378545b31 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:52.683284 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-102aec86-6ae1-432b-96fd-837378545b31 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:52.693092 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-102aec86-6ae1-432b-96fd-837378545b31 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:52.693732 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-102aec86-6ae1-432b-96fd-837378545b31 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:52.694275 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-102aec86-6ae1-432b-96fd-837378545b31 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:52.695054 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-102aec86-6ae1-432b-96fd-837378545b31 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:52.695585 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-102aec86-6ae1-432b-96fd-837378545b31 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:52.696125 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-102aec86-6ae1-432b-96fd-837378545b31 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:52.845479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-102aec86-6ae1-432b-96fd-837378545b31 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:52.854166 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-102aec86-6ae1-432b-96fd-837378545b31 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1265 microversion: 2.1 time: 0.176085 Aug 24 12:37:52.854741 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 330/662] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:52 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:53.315817 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e848fa67-869b-4808-872e-2ae7d4b9b98a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:53.316839 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e848fa67-869b-4808-872e-2ae7d4b9b98a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:53.329478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e848fa67-869b-4808-872e-2ae7d4b9b98a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:53.330781 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e848fa67-869b-4808-872e-2ae7d4b9b98a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:53.331191 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e848fa67-869b-4808-872e-2ae7d4b9b98a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:53.332148 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e848fa67-869b-4808-872e-2ae7d4b9b98a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:53.333126 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e848fa67-869b-4808-872e-2ae7d4b9b98a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:53.334420 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e848fa67-869b-4808-872e-2ae7d4b9b98a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:53.492770 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e848fa67-869b-4808-872e-2ae7d4b9b98a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:53.501742 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e848fa67-869b-4808-872e-2ae7d4b9b98a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:53.503451 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e848fa67-869b-4808-872e-2ae7d4b9b98a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:53.504665 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e848fa67-869b-4808-872e-2ae7d4b9b98a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1734 microversion: 2.20 time: 0.195456 Aug 24 12:37:53.505225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 333/663] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:53 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:53.878018 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f815e9ad-a768-473b-9b48-e95ae352d3e7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:53.878018 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f815e9ad-a768-473b-9b48-e95ae352d3e7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:53.889566 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f815e9ad-a768-473b-9b48-e95ae352d3e7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:53.890067 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f815e9ad-a768-473b-9b48-e95ae352d3e7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:53.890505 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f815e9ad-a768-473b-9b48-e95ae352d3e7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:53.891218 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f815e9ad-a768-473b-9b48-e95ae352d3e7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:53.891695 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f815e9ad-a768-473b-9b48-e95ae352d3e7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:53.892124 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f815e9ad-a768-473b-9b48-e95ae352d3e7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:54.037328 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f815e9ad-a768-473b-9b48-e95ae352d3e7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:54.045922 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f815e9ad-a768-473b-9b48-e95ae352d3e7 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1265 microversion: 2.1 time: 0.175225 Aug 24 12:37:54.059575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 331/664] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:53 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:54.528539 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-42bd6ce4-20fd-4420-937a-4623bfc4a9bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:54.529919 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-42bd6ce4-20fd-4420-937a-4623bfc4a9bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:54.536618 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-42bd6ce4-20fd-4420-937a-4623bfc4a9bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:54.537197 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-42bd6ce4-20fd-4420-937a-4623bfc4a9bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:54.537634 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-42bd6ce4-20fd-4420-937a-4623bfc4a9bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:54.538323 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-42bd6ce4-20fd-4420-937a-4623bfc4a9bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:54.538796 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-42bd6ce4-20fd-4420-937a-4623bfc4a9bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:54.539211 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-42bd6ce4-20fd-4420-937a-4623bfc4a9bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:54.678491 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-42bd6ce4-20fd-4420-937a-4623bfc4a9bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:54.687250 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-42bd6ce4-20fd-4420-937a-4623bfc4a9bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:54.688799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-42bd6ce4-20fd-4420-937a-4623bfc4a9bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:54.689970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-42bd6ce4-20fd-4420-937a-4623bfc4a9bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1734 microversion: 2.20 time: 0.165379 Aug 24 12:37:54.690578 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 334/665] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:54 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:55.067367 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-4924f951-7a55-47d4-8b49-04ec145ee509 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:55.068107 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-4924f951-7a55-47d4-8b49-04ec145ee509 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:55.084037 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4924f951-7a55-47d4-8b49-04ec145ee509 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:55.085009 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4924f951-7a55-47d4-8b49-04ec145ee509 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:55.085647 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4924f951-7a55-47d4-8b49-04ec145ee509 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:55.086594 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4924f951-7a55-47d4-8b49-04ec145ee509 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:55.087060 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4924f951-7a55-47d4-8b49-04ec145ee509 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:55.087516 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4924f951-7a55-47d4-8b49-04ec145ee509 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:55.254535 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-4924f951-7a55-47d4-8b49-04ec145ee509 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:55.262937 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-4924f951-7a55-47d4-8b49-04ec145ee509 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1265 microversion: 2.1 time: 0.199532 Aug 24 12:37:55.264108 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 332/666] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:55 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:55.714186 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-59a01d53-be01-48d6-8a24-8be3c5ebc890 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:55.714992 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-59a01d53-be01-48d6-8a24-8be3c5ebc890 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:55.722044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59a01d53-be01-48d6-8a24-8be3c5ebc890 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:55.722640 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59a01d53-be01-48d6-8a24-8be3c5ebc890 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:55.722942 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59a01d53-be01-48d6-8a24-8be3c5ebc890 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:55.724059 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59a01d53-be01-48d6-8a24-8be3c5ebc890 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:55.724736 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59a01d53-be01-48d6-8a24-8be3c5ebc890 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:55.725364 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59a01d53-be01-48d6-8a24-8be3c5ebc890 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:55.896860 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-59a01d53-be01-48d6-8a24-8be3c5ebc890 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:55.908359 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-59a01d53-be01-48d6-8a24-8be3c5ebc890 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:55.909857 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-59a01d53-be01-48d6-8a24-8be3c5ebc890 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:55.911016 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-59a01d53-be01-48d6-8a24-8be3c5ebc890 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1734 microversion: 2.20 time: 0.200967 Aug 24 12:37:55.912402 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 335/667] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:55 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:56.285218 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9fe9a0fd-5eaf-4b23-a986-38bf2bda5983 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:56.286682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-9fe9a0fd-5eaf-4b23-a986-38bf2bda5983 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:56.294160 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fe9a0fd-5eaf-4b23-a986-38bf2bda5983 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:56.296117 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fe9a0fd-5eaf-4b23-a986-38bf2bda5983 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:56.296819 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fe9a0fd-5eaf-4b23-a986-38bf2bda5983 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:56.297785 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fe9a0fd-5eaf-4b23-a986-38bf2bda5983 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:56.298507 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fe9a0fd-5eaf-4b23-a986-38bf2bda5983 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:56.299131 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fe9a0fd-5eaf-4b23-a986-38bf2bda5983 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:56.448572 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-9fe9a0fd-5eaf-4b23-a986-38bf2bda5983 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:56.458988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9fe9a0fd-5eaf-4b23-a986-38bf2bda5983 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1265 microversion: 2.1 time: 0.178628 Aug 24 12:37:56.459739 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 333/668] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:56 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:56.934536 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7b69de09-49a0-48bf-9a78-f7b34f7e1df5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:56.935496 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-7b69de09-49a0-48bf-9a78-f7b34f7e1df5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:56.942383 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7b69de09-49a0-48bf-9a78-f7b34f7e1df5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:56.943156 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7b69de09-49a0-48bf-9a78-f7b34f7e1df5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:56.943719 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7b69de09-49a0-48bf-9a78-f7b34f7e1df5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:56.944511 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7b69de09-49a0-48bf-9a78-f7b34f7e1df5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:56.945228 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7b69de09-49a0-48bf-9a78-f7b34f7e1df5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:56.945868 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7b69de09-49a0-48bf-9a78-f7b34f7e1df5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:57.096681 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-7b69de09-49a0-48bf-9a78-f7b34f7e1df5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:57.106872 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-7b69de09-49a0-48bf-9a78-f7b34f7e1df5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:57.109336 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-7b69de09-49a0-48bf-9a78-f7b34f7e1df5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:57.110799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-7b69de09-49a0-48bf-9a78-f7b34f7e1df5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1734 microversion: 2.20 time: 0.180386 Aug 24 12:37:57.124622 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 336/669] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:56 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1734 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:57.480872 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d6baf871-197d-4101-ad6f-4291bca8d163 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:57.482667 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d6baf871-197d-4101-ad6f-4291bca8d163 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:57.493098 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:57.501966 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d6baf871-197d-4101-ad6f-4291bca8d163 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:57.502674 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d6baf871-197d-4101-ad6f-4291bca8d163 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:57.503273 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d6baf871-197d-4101-ad6f-4291bca8d163 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:57.504167 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d6baf871-197d-4101-ad6f-4291bca8d163 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:57.504774 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d6baf871-197d-4101-ad6f-4291bca8d163 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:57.505353 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d6baf871-197d-4101-ad6f-4291bca8d163 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:57.705311 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-d6baf871-197d-4101-ad6f-4291bca8d163 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:57.716143 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d6baf871-197d-4101-ad6f-4291bca8d163 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1265 microversion: 2.1 time: 0.238504 Aug 24 12:37:57.717762 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 334/670] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:57 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:37:58.135996 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-6dad1b5b-bb8e-431f-98ba-70a67fe96645 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:58.137460 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-6dad1b5b-bb8e-431f-98ba-70a67fe96645 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:58.141911 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:58.142856 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=6 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:58.144182 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:58.149634 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6dad1b5b-bb8e-431f-98ba-70a67fe96645 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:58.150418 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6dad1b5b-bb8e-431f-98ba-70a67fe96645 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:58.151055 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6dad1b5b-bb8e-431f-98ba-70a67fe96645 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:58.152504 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6dad1b5b-bb8e-431f-98ba-70a67fe96645 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:58.153160 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6dad1b5b-bb8e-431f-98ba-70a67fe96645 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:58.153810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6dad1b5b-bb8e-431f-98ba-70a67fe96645 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:58.314475 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6dad1b5b-bb8e-431f-98ba-70a67fe96645 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:58.325104 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6dad1b5b-bb8e-431f-98ba-70a67fe96645 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:58.327844 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6dad1b5b-bb8e-431f-98ba-70a67fe96645 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:58.329158 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-6dad1b5b-bb8e-431f-98ba-70a67fe96645 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1734 microversion: 2.20 time: 0.197672 Aug 24 12:37:58.329731 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 337/671] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:58 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1734 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:58.738118 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5f3a4e69-f10c-4e97-9e3c-693a91339c95 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:58.739435 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5f3a4e69-f10c-4e97-9e3c-693a91339c95 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:58.742680 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:58.747010 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5f3a4e69-f10c-4e97-9e3c-693a91339c95 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:58.756400 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5f3a4e69-f10c-4e97-9e3c-693a91339c95 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:58.756400 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5f3a4e69-f10c-4e97-9e3c-693a91339c95 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:58.756400 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5f3a4e69-f10c-4e97-9e3c-693a91339c95 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:58.756400 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5f3a4e69-f10c-4e97-9e3c-693a91339c95 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:58.756745 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5f3a4e69-f10c-4e97-9e3c-693a91339c95 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:58.935730 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5f3a4e69-f10c-4e97-9e3c-693a91339c95 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:58.939176 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=100 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:58.945604 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5f3a4e69-f10c-4e97-9e3c-693a91339c95 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1265 microversion: 2.1 time: 0.211262 Aug 24 12:37:58.946366 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 335/672] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:58 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:59.358121 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-81047d30-708f-48e8-bfb7-5035d5edcc06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:59.360002 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-81047d30-708f-48e8-bfb7-5035d5edcc06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:59.371345 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-81047d30-708f-48e8-bfb7-5035d5edcc06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:59.374002 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-81047d30-708f-48e8-bfb7-5035d5edcc06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:59.374936 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-81047d30-708f-48e8-bfb7-5035d5edcc06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:59.377583 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-81047d30-708f-48e8-bfb7-5035d5edcc06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:59.378214 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-81047d30-708f-48e8-bfb7-5035d5edcc06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:59.380126 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-81047d30-708f-48e8-bfb7-5035d5edcc06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:59.546241 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-81047d30-708f-48e8-bfb7-5035d5edcc06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:59.555758 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-81047d30-708f-48e8-bfb7-5035d5edcc06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:59.557772 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-81047d30-708f-48e8-bfb7-5035d5edcc06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:59.559264 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-81047d30-708f-48e8-bfb7-5035d5edcc06 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1734 microversion: 2.20 time: 0.207164 Aug 24 12:37:59.560640 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 338/673] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:59 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1734 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:59.967033 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0ce338a2-0167-4739-ae42-9dc151ced320 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:59.967603 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0ce338a2-0167-4739-ae42-9dc151ced320 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:59.977327 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0ce338a2-0167-4739-ae42-9dc151ced320 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:59.977836 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0ce338a2-0167-4739-ae42-9dc151ced320 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:59.978276 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0ce338a2-0167-4739-ae42-9dc151ced320 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:59.978997 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0ce338a2-0167-4739-ae42-9dc151ced320 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:59.979456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0ce338a2-0167-4739-ae42-9dc151ced320 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:59.979903 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0ce338a2-0167-4739-ae42-9dc151ced320 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:00.148496 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-0ce338a2-0167-4739-ae42-9dc151ced320 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:00.158842 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0ce338a2-0167-4739-ae42-9dc151ced320 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1265 microversion: 2.1 time: 0.195826 Aug 24 12:38:00.159792 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 336/674] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:59 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:00.584809 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-6ce32de6-9925-4653-9ef6-a5f6914a2854 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:00.585404 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-6ce32de6-9925-4653-9ef6-a5f6914a2854 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:00.592156 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6ce32de6-9925-4653-9ef6-a5f6914a2854 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:00.593009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6ce32de6-9925-4653-9ef6-a5f6914a2854 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:00.593519 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6ce32de6-9925-4653-9ef6-a5f6914a2854 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:00.594220 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6ce32de6-9925-4653-9ef6-a5f6914a2854 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:00.594653 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6ce32de6-9925-4653-9ef6-a5f6914a2854 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:00.595075 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6ce32de6-9925-4653-9ef6-a5f6914a2854 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:00.752106 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6ce32de6-9925-4653-9ef6-a5f6914a2854 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:00.760969 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6ce32de6-9925-4653-9ef6-a5f6914a2854 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:00.762532 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6ce32de6-9925-4653-9ef6-a5f6914a2854 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:00.764560 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-6ce32de6-9925-4653-9ef6-a5f6914a2854 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1734 microversion: 2.20 time: 0.183498 Aug 24 12:38:00.765325 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 339/675] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:00 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:01.180942 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9f88f66b-607a-4644-bb32-7751ecfca113 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:01.181801 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-9f88f66b-607a-4644-bb32-7751ecfca113 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:01.194182 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9f88f66b-607a-4644-bb32-7751ecfca113 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:01.194966 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9f88f66b-607a-4644-bb32-7751ecfca113 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:01.195577 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9f88f66b-607a-4644-bb32-7751ecfca113 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:01.196834 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9f88f66b-607a-4644-bb32-7751ecfca113 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:01.197456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9f88f66b-607a-4644-bb32-7751ecfca113 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:01.198039 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9f88f66b-607a-4644-bb32-7751ecfca113 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:01.358781 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-9f88f66b-607a-4644-bb32-7751ecfca113 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:01.366371 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9f88f66b-607a-4644-bb32-7751ecfca113 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1265 microversion: 2.1 time: 0.189153 Aug 24 12:38:01.367191 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 337/676] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:01 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:01.411029 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-e023320d-7b08-49df-ab9b-f4eb011e1f83 req-9aad392c-a96b-4687-bc7b-122925e39a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee223a9-b84a-4d31-8bd1-a8335fbceff5", "name": "network-vif-plugged", "status": "completed", "tag": "da346dda-746e-4fae-941a-4376508f9cef"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:01.421247 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-e023320d-7b08-49df-ab9b-f4eb011e1f83 req-9aad392c-a96b-4687-bc7b-122925e39a49 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:01.421774 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-e023320d-7b08-49df-ab9b-f4eb011e1f83 req-9aad392c-a96b-4687-bc7b-122925e39a49 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:01.422296 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-e023320d-7b08-49df-ab9b-f4eb011e1f83 req-9aad392c-a96b-4687-bc7b-122925e39a49 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:01.434138 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-e023320d-7b08-49df-ab9b-f4eb011e1f83 req-9aad392c-a96b-4687-bc7b-122925e39a49 service nova] Creating event network-vif-plugged:da346dda-746e-4fae-941a-4376508f9cef for instance cee223a9-b84a-4d31-8bd1-a8335fbceff5 on hv-cinder-84890 Aug 24 12:38:01.440213 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-e023320d-7b08-49df-ab9b-f4eb011e1f83 req-9aad392c-a96b-4687-bc7b-122925e39a49 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032727 Aug 24 12:38:01.440914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 340/677] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:01.787648 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-78e1b6fe-3185-4cce-83dd-c43f2d788d2c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:01.788255 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-78e1b6fe-3185-4cce-83dd-c43f2d788d2c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:01.794191 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-78e1b6fe-3185-4cce-83dd-c43f2d788d2c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:01.796116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-78e1b6fe-3185-4cce-83dd-c43f2d788d2c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:01.796566 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-78e1b6fe-3185-4cce-83dd-c43f2d788d2c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:01.797287 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-78e1b6fe-3185-4cce-83dd-c43f2d788d2c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:01.797752 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-78e1b6fe-3185-4cce-83dd-c43f2d788d2c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:01.798184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-78e1b6fe-3185-4cce-83dd-c43f2d788d2c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:02.025207 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-78e1b6fe-3185-4cce-83dd-c43f2d788d2c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:02.034422 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-78e1b6fe-3185-4cce-83dd-c43f2d788d2c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:02.035949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-78e1b6fe-3185-4cce-83dd-c43f2d788d2c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:02.037125 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-78e1b6fe-3185-4cce-83dd-c43f2d788d2c tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1716 microversion: 2.20 time: 0.253461 Aug 24 12:38:02.037694 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 338/678] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:01 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1716 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:02.390992 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c9ebde58-793e-48f2-91e5-ed1291036f69 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:02.391713 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c9ebde58-793e-48f2-91e5-ed1291036f69 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:02.398333 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c9ebde58-793e-48f2-91e5-ed1291036f69 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:02.398807 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c9ebde58-793e-48f2-91e5-ed1291036f69 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:02.399454 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c9ebde58-793e-48f2-91e5-ed1291036f69 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:02.400310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c9ebde58-793e-48f2-91e5-ed1291036f69 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:02.400930 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c9ebde58-793e-48f2-91e5-ed1291036f69 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:02.401499 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c9ebde58-793e-48f2-91e5-ed1291036f69 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:02.554777 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c9ebde58-793e-48f2-91e5-ed1291036f69 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:02.563020 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c9ebde58-793e-48f2-91e5-ed1291036f69 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1265 microversion: 2.1 time: 0.177799 Aug 24 12:38:02.563593 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 341/679] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:02 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:03.061721 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-18706a2b-adc8-4804-a320-77f6fb5d06e9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:03.062436 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-18706a2b-adc8-4804-a320-77f6fb5d06e9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:03.070054 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-18706a2b-adc8-4804-a320-77f6fb5d06e9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:03.070700 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-18706a2b-adc8-4804-a320-77f6fb5d06e9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:03.071442 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-18706a2b-adc8-4804-a320-77f6fb5d06e9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:03.073049 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-18706a2b-adc8-4804-a320-77f6fb5d06e9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:03.073590 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-18706a2b-adc8-4804-a320-77f6fb5d06e9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:03.074092 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-18706a2b-adc8-4804-a320-77f6fb5d06e9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:03.210865 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-18706a2b-adc8-4804-a320-77f6fb5d06e9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:03.220078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-18706a2b-adc8-4804-a320-77f6fb5d06e9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:03.221758 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-18706a2b-adc8-4804-a320-77f6fb5d06e9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:03.223071 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-18706a2b-adc8-4804-a320-77f6fb5d06e9 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1716 microversion: 2.20 time: 0.165703 Aug 24 12:38:03.223748 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 339/680] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:03 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1716 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:03.584647 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-476b80b2-4d8e-4b57-8774-137d99d21777 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:03.585382 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-476b80b2-4d8e-4b57-8774-137d99d21777 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:03.592076 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-476b80b2-4d8e-4b57-8774-137d99d21777 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:03.592545 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-476b80b2-4d8e-4b57-8774-137d99d21777 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:03.592978 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-476b80b2-4d8e-4b57-8774-137d99d21777 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:03.593667 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-476b80b2-4d8e-4b57-8774-137d99d21777 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:03.594113 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-476b80b2-4d8e-4b57-8774-137d99d21777 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:03.594531 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-476b80b2-4d8e-4b57-8774-137d99d21777 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:03.745852 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-476b80b2-4d8e-4b57-8774-137d99d21777 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:03.753911 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-476b80b2-4d8e-4b57-8774-137d99d21777 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1453 microversion: 2.1 time: 0.173640 Aug 24 12:38:03.754461 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 342/681] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:03 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:03.774349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d09bda66-ff68-4c93-b937-4a0091bd6136 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:03.775243 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d09bda66-ff68-4c93-b937-4a0091bd6136 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:03.781602 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d09bda66-ff68-4c93-b937-4a0091bd6136 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:03.782205 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d09bda66-ff68-4c93-b937-4a0091bd6136 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:03.782715 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d09bda66-ff68-4c93-b937-4a0091bd6136 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:03.783417 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d09bda66-ff68-4c93-b937-4a0091bd6136 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:03.783903 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d09bda66-ff68-4c93-b937-4a0091bd6136 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:03.784396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d09bda66-ff68-4c93-b937-4a0091bd6136 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:03.927245 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-d09bda66-ff68-4c93-b937-4a0091bd6136 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:03.935961 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d09bda66-ff68-4c93-b937-4a0091bd6136 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1453 microversion: 2.1 time: 0.164834 Aug 24 12:38:03.936727 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 340/682] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:03 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:04.247909 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-52e19dae-6ba8-49f1-a5ce-930cfbce2113 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:04.248519 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-52e19dae-6ba8-49f1-a5ce-930cfbce2113 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:04.255661 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-52e19dae-6ba8-49f1-a5ce-930cfbce2113 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:04.256438 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-52e19dae-6ba8-49f1-a5ce-930cfbce2113 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:04.256976 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-52e19dae-6ba8-49f1-a5ce-930cfbce2113 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:04.257778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-52e19dae-6ba8-49f1-a5ce-930cfbce2113 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:04.258332 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-52e19dae-6ba8-49f1-a5ce-930cfbce2113 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:04.258831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-52e19dae-6ba8-49f1-a5ce-930cfbce2113 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:04.453240 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-52e19dae-6ba8-49f1-a5ce-930cfbce2113 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:04.461740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-52e19dae-6ba8-49f1-a5ce-930cfbce2113 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:04.463222 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-52e19dae-6ba8-49f1-a5ce-930cfbce2113 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:04.464412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-52e19dae-6ba8-49f1-a5ce-930cfbce2113 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1716 microversion: 2.20 time: 0.221680 Aug 24 12:38:04.465155 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 343/683] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:04 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1716 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:05.275471 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-c8d7ebe8-97ab-41eb-a774-bd28cb34d87a req-4ac58baf-ced9-44d2-8672-80f5df3c3069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec78743-6cd7-4df3-a22c-72acff29cf1a", "name": "network-vif-unplugged", "status": "completed", "tag": "50ca3644-951e-4983-8b1f-534cdf89c8cb"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:05.290975 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-c8d7ebe8-97ab-41eb-a774-bd28cb34d87a req-4ac58baf-ced9-44d2-8672-80f5df3c3069 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:05.291649 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-c8d7ebe8-97ab-41eb-a774-bd28cb34d87a req-4ac58baf-ced9-44d2-8672-80f5df3c3069 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:05.292535 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-c8d7ebe8-97ab-41eb-a774-bd28cb34d87a req-4ac58baf-ced9-44d2-8672-80f5df3c3069 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:05.311096 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-c8d7ebe8-97ab-41eb-a774-bd28cb34d87a req-4ac58baf-ced9-44d2-8672-80f5df3c3069 service nova] Creating event network-vif-unplugged:50ca3644-951e-4983-8b1f-534cdf89c8cb for instance cec78743-6cd7-4df3-a22c-72acff29cf1a on hv-cinder-84890 Aug 24 12:38:05.316457 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-c8d7ebe8-97ab-41eb-a774-bd28cb34d87a req-4ac58baf-ced9-44d2-8672-80f5df3c3069 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044972 Aug 24 12:38:05.317321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 341/684] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:05.488844 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9177a46f-ab80-4401-9d87-a4aef2c65dc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:05.489443 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9177a46f-ab80-4401-9d87-a4aef2c65dc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:05.495709 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9177a46f-ab80-4401-9d87-a4aef2c65dc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:05.496193 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9177a46f-ab80-4401-9d87-a4aef2c65dc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:05.496619 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9177a46f-ab80-4401-9d87-a4aef2c65dc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:05.497892 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9177a46f-ab80-4401-9d87-a4aef2c65dc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:05.498998 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9177a46f-ab80-4401-9d87-a4aef2c65dc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:05.498998 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9177a46f-ab80-4401-9d87-a4aef2c65dc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:05.727201 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9177a46f-ab80-4401-9d87-a4aef2c65dc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:05.739419 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9177a46f-ab80-4401-9d87-a4aef2c65dc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:05.741716 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9177a46f-ab80-4401-9d87-a4aef2c65dc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:05.742937 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9177a46f-ab80-4401-9d87-a4aef2c65dc7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1719 microversion: 2.20 time: 0.258044 Aug 24 12:38:05.743913 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 344/685] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:05 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1719 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:05.769963 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e8b601fa-193a-4be3-954b-b17ddf193f38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ad35b8d-56f7-4d1a-a577-81c7d8bc5c00"}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:05.774661 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e8b601fa-193a-4be3-954b-b17ddf193f38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:05.792083 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e8b601fa-193a-4be3-954b-b17ddf193f38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:05.792591 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e8b601fa-193a-4be3-954b-b17ddf193f38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:05.793118 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e8b601fa-193a-4be3-954b-b17ddf193f38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:05.794083 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e8b601fa-193a-4be3-954b-b17ddf193f38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:05.795261 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e8b601fa-193a-4be3-954b-b17ddf193f38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:05.795744 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e8b601fa-193a-4be3-954b-b17ddf193f38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:05.983122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-fc377eb7-6e69-427d-bdd4-e2ca7f390f0a req-2c0b5d90-5ac6-490d-b3bc-96bbb2bca7ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee223a9-b84a-4d31-8bd1-a8335fbceff5", "tag": "da346dda-746e-4fae-941a-4376508f9cef"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:05.992526 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-fc377eb7-6e69-427d-bdd4-e2ca7f390f0a req-2c0b5d90-5ac6-490d-b3bc-96bbb2bca7ec service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:05.993013 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-fc377eb7-6e69-427d-bdd4-e2ca7f390f0a req-2c0b5d90-5ac6-490d-b3bc-96bbb2bca7ec service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:05.993539 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-fc377eb7-6e69-427d-bdd4-e2ca7f390f0a req-2c0b5d90-5ac6-490d-b3bc-96bbb2bca7ec service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:06.005471 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-fc377eb7-6e69-427d-bdd4-e2ca7f390f0a req-2c0b5d90-5ac6-490d-b3bc-96bbb2bca7ec service nova] Creating event network-changed:da346dda-746e-4fae-941a-4376508f9cef for instance cee223a9-b84a-4d31-8bd1-a8335fbceff5 on hv-cinder-84890 Aug 24 12:38:06.010384 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-fc377eb7-6e69-427d-bdd4-e2ca7f390f0a req-2c0b5d90-5ac6-490d-b3bc-96bbb2bca7ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215838 Aug 24 12:38:06.011003 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 345/686] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:06.131318 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e8b601fa-193a-4be3-954b-b17ddf193f38 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "POST /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.368143 Aug 24 12:38:06.132339 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 342/687] 10.222.0.58 () {62 vars in 1364 bytes} [Wed Aug 24 12:38:05 2022] POST /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a/os-volume_attachments => generated 188 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:06.271906 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ba3d267f-4c9a-469c-990d-4c8d5f738d39 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:06.272761 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-ba3d267f-4c9a-469c-990d-4c8d5f738d39 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:06.279413 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ba3d267f-4c9a-469c-990d-4c8d5f738d39 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:06.279938 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ba3d267f-4c9a-469c-990d-4c8d5f738d39 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:06.280559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ba3d267f-4c9a-469c-990d-4c8d5f738d39 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:06.281495 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ba3d267f-4c9a-469c-990d-4c8d5f738d39 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:06.281880 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ba3d267f-4c9a-469c-990d-4c8d5f738d39 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:06.282296 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ba3d267f-4c9a-469c-990d-4c8d5f738d39 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:06.586127 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-ba3d267f-4c9a-469c-990d-4c8d5f738d39 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a/os-volume_attachments/0ad35b8d-56f7-4d1a-a577-81c7d8bc5c00" status: 202 len: 0 microversion: 2.20 time: 0.317660 Aug 24 12:38:06.590286 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 346/688] 10.222.0.58 () {60 vars in 1457 bytes} [Wed Aug 24 12:38:06 2022] DELETE /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a/os-volume_attachments/0ad35b8d-56f7-4d1a-a577-81c7d8bc5c00 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:38:06.660479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-742d3a5c-d99c-4501-ab86-6a42a2e061bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:06.661138 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-742d3a5c-d99c-4501-ab86-6a42a2e061bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:06.668152 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-742d3a5c-d99c-4501-ab86-6a42a2e061bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:06.668644 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-742d3a5c-d99c-4501-ab86-6a42a2e061bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:06.669138 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-742d3a5c-d99c-4501-ab86-6a42a2e061bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:06.670876 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-742d3a5c-d99c-4501-ab86-6a42a2e061bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:06.671549 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-742d3a5c-d99c-4501-ab86-6a42a2e061bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:06.672011 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-742d3a5c-d99c-4501-ab86-6a42a2e061bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:06.828941 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-742d3a5c-d99c-4501-ab86-6a42a2e061bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127307) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 12:38:06.903110 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-742d3a5c-d99c-4501-ab86-6a42a2e061bc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "POST /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a/action" status: 202 len: 0 microversion: 2.20 time: 0.247253 Aug 24 12:38:06.903799 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 343/689] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 12:38:06 2022] POST /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 12:38:06.912025 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-87f9675e-0cf8-4d13-974e-1789a2f96468 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:06.912629 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-87f9675e-0cf8-4d13-974e-1789a2f96468 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:06.918995 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-87f9675e-0cf8-4d13-974e-1789a2f96468 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:06.919872 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-87f9675e-0cf8-4d13-974e-1789a2f96468 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:06.921037 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-87f9675e-0cf8-4d13-974e-1789a2f96468 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:06.922184 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-87f9675e-0cf8-4d13-974e-1789a2f96468 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:06.922964 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-87f9675e-0cf8-4d13-974e-1789a2f96468 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:06.923517 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-87f9675e-0cf8-4d13-974e-1789a2f96468 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:06.929337 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:07.105401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-87f9675e-0cf8-4d13-974e-1789a2f96468 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:07.114614 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-87f9675e-0cf8-4d13-974e-1789a2f96468 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:07.116193 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-87f9675e-0cf8-4d13-974e-1789a2f96468 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:07.117356 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-87f9675e-0cf8-4d13-974e-1789a2f96468 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1667 microversion: 2.20 time: 0.209283 Aug 24 12:38:07.118084 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 347/690] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:06 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1667 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:08.142338 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f5bf689b-1e09-47f4-9b8c-7b126e6745e6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:08.142967 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f5bf689b-1e09-47f4-9b8c-7b126e6745e6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:08.148799 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f5bf689b-1e09-47f4-9b8c-7b126e6745e6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:08.149290 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f5bf689b-1e09-47f4-9b8c-7b126e6745e6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:08.149733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f5bf689b-1e09-47f4-9b8c-7b126e6745e6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:08.150424 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f5bf689b-1e09-47f4-9b8c-7b126e6745e6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:08.150963 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f5bf689b-1e09-47f4-9b8c-7b126e6745e6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:08.151280 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f5bf689b-1e09-47f4-9b8c-7b126e6745e6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:08.402557 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f5bf689b-1e09-47f4-9b8c-7b126e6745e6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:08.411414 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f5bf689b-1e09-47f4-9b8c-7b126e6745e6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:08.413029 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f5bf689b-1e09-47f4-9b8c-7b126e6745e6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:08.414291 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f5bf689b-1e09-47f4-9b8c-7b126e6745e6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.277213 Aug 24 12:38:08.414937 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 344/691] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:08 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:09.437944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e0b24536-4204-4d24-90de-adb9f78bc12e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:09.438547 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e0b24536-4204-4d24-90de-adb9f78bc12e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:09.445324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e0b24536-4204-4d24-90de-adb9f78bc12e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:09.445882 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e0b24536-4204-4d24-90de-adb9f78bc12e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:09.446274 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e0b24536-4204-4d24-90de-adb9f78bc12e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:09.447074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e0b24536-4204-4d24-90de-adb9f78bc12e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:09.447774 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e0b24536-4204-4d24-90de-adb9f78bc12e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:09.448264 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e0b24536-4204-4d24-90de-adb9f78bc12e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:09.609733 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e0b24536-4204-4d24-90de-adb9f78bc12e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:09.618380 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e0b24536-4204-4d24-90de-adb9f78bc12e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:09.619916 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e0b24536-4204-4d24-90de-adb9f78bc12e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:09.621066 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e0b24536-4204-4d24-90de-adb9f78bc12e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.187121 Aug 24 12:38:09.621831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 348/692] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:09 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:10.645319 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-7f18e9fb-7a3f-4fd5-86b1-709eca5d3fcc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:10.646033 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-7f18e9fb-7a3f-4fd5-86b1-709eca5d3fcc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:10.652938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f18e9fb-7a3f-4fd5-86b1-709eca5d3fcc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:10.653568 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f18e9fb-7a3f-4fd5-86b1-709eca5d3fcc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:10.654181 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f18e9fb-7a3f-4fd5-86b1-709eca5d3fcc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:10.654899 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f18e9fb-7a3f-4fd5-86b1-709eca5d3fcc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:10.655359 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f18e9fb-7a3f-4fd5-86b1-709eca5d3fcc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:10.655812 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f18e9fb-7a3f-4fd5-86b1-709eca5d3fcc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:10.816057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7f18e9fb-7a3f-4fd5-86b1-709eca5d3fcc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:10.826052 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7f18e9fb-7a3f-4fd5-86b1-709eca5d3fcc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:10.827904 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7f18e9fb-7a3f-4fd5-86b1-709eca5d3fcc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:10.829197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-7f18e9fb-7a3f-4fd5-86b1-709eca5d3fcc tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.188274 Aug 24 12:38:10.829977 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 345/693] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:10 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:11.853138 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-06741352-c7cd-4ce1-b7fc-b525183874e5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:11.853722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-06741352-c7cd-4ce1-b7fc-b525183874e5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:11.860793 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-06741352-c7cd-4ce1-b7fc-b525183874e5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:11.861690 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-06741352-c7cd-4ce1-b7fc-b525183874e5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:11.862124 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-06741352-c7cd-4ce1-b7fc-b525183874e5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:11.862813 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-06741352-c7cd-4ce1-b7fc-b525183874e5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:11.863255 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-06741352-c7cd-4ce1-b7fc-b525183874e5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:11.863693 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-06741352-c7cd-4ce1-b7fc-b525183874e5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:12.021108 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-06741352-c7cd-4ce1-b7fc-b525183874e5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:12.029941 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-06741352-c7cd-4ce1-b7fc-b525183874e5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:12.031475 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-06741352-c7cd-4ce1-b7fc-b525183874e5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:12.032664 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-06741352-c7cd-4ce1-b7fc-b525183874e5 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.183507 Aug 24 12:38:12.033222 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 349/694] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:11 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:13.057241 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2ce6fee1-9e90-499a-9ac3-63eb3b07a62e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:13.058263 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2ce6fee1-9e90-499a-9ac3-63eb3b07a62e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:13.065642 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2ce6fee1-9e90-499a-9ac3-63eb3b07a62e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:13.066124 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2ce6fee1-9e90-499a-9ac3-63eb3b07a62e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:13.066556 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2ce6fee1-9e90-499a-9ac3-63eb3b07a62e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:13.067260 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2ce6fee1-9e90-499a-9ac3-63eb3b07a62e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:13.067789 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2ce6fee1-9e90-499a-9ac3-63eb3b07a62e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:13.068209 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2ce6fee1-9e90-499a-9ac3-63eb3b07a62e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:13.207949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2ce6fee1-9e90-499a-9ac3-63eb3b07a62e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:13.216565 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2ce6fee1-9e90-499a-9ac3-63eb3b07a62e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:13.218067 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2ce6fee1-9e90-499a-9ac3-63eb3b07a62e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:13.219379 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2ce6fee1-9e90-499a-9ac3-63eb3b07a62e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.166220 Aug 24 12:38:13.220268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 346/695] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:13 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:14.243293 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1c84a599-96c2-40af-a3bc-f07db24b3a70 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:14.243967 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1c84a599-96c2-40af-a3bc-f07db24b3a70 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:14.251252 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1c84a599-96c2-40af-a3bc-f07db24b3a70 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:14.251770 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1c84a599-96c2-40af-a3bc-f07db24b3a70 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:14.252205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1c84a599-96c2-40af-a3bc-f07db24b3a70 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:14.252906 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1c84a599-96c2-40af-a3bc-f07db24b3a70 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:14.253353 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1c84a599-96c2-40af-a3bc-f07db24b3a70 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:14.253775 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1c84a599-96c2-40af-a3bc-f07db24b3a70 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:14.402620 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1c84a599-96c2-40af-a3bc-f07db24b3a70 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:14.415026 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1c84a599-96c2-40af-a3bc-f07db24b3a70 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:14.416719 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1c84a599-96c2-40af-a3bc-f07db24b3a70 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:14.417888 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1c84a599-96c2-40af-a3bc-f07db24b3a70 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.179470 Aug 24 12:38:14.418639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 350/696] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:14 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:15.441544 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-97f5397f-37bb-45ef-aaa6-2e0a9e07bdac tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:15.442167 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-97f5397f-37bb-45ef-aaa6-2e0a9e07bdac tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:15.451282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-97f5397f-37bb-45ef-aaa6-2e0a9e07bdac tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:15.451811 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-97f5397f-37bb-45ef-aaa6-2e0a9e07bdac tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:15.452250 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-97f5397f-37bb-45ef-aaa6-2e0a9e07bdac tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:15.455034 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-97f5397f-37bb-45ef-aaa6-2e0a9e07bdac tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:15.455572 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-97f5397f-37bb-45ef-aaa6-2e0a9e07bdac tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:15.455984 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-97f5397f-37bb-45ef-aaa6-2e0a9e07bdac tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:15.826380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-97f5397f-37bb-45ef-aaa6-2e0a9e07bdac tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:15.837178 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-97f5397f-37bb-45ef-aaa6-2e0a9e07bdac tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:15.838741 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-97f5397f-37bb-45ef-aaa6-2e0a9e07bdac tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:15.839978 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-97f5397f-37bb-45ef-aaa6-2e0a9e07bdac tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.402681 Aug 24 12:38:15.840900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 347/697] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:15 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:16.863276 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9c7daf08-1614-4186-823c-01b2b1c03582 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:16.863957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9c7daf08-1614-4186-823c-01b2b1c03582 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:16.870269 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9c7daf08-1614-4186-823c-01b2b1c03582 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:16.870751 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9c7daf08-1614-4186-823c-01b2b1c03582 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:16.871178 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9c7daf08-1614-4186-823c-01b2b1c03582 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:16.871994 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9c7daf08-1614-4186-823c-01b2b1c03582 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:16.872445 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9c7daf08-1614-4186-823c-01b2b1c03582 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:16.872862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9c7daf08-1614-4186-823c-01b2b1c03582 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:17.010750 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9c7daf08-1614-4186-823c-01b2b1c03582 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:17.019311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9c7daf08-1614-4186-823c-01b2b1c03582 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:17.020846 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9c7daf08-1614-4186-823c-01b2b1c03582 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:17.022021 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9c7daf08-1614-4186-823c-01b2b1c03582 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.162591 Aug 24 12:38:17.022757 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 351/698] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:16 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:18.047247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-cd125fa2-628e-4abb-b6c2-cc7cfba5f233 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:18.048058 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-cd125fa2-628e-4abb-b6c2-cc7cfba5f233 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:18.054969 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cd125fa2-628e-4abb-b6c2-cc7cfba5f233 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:18.055463 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cd125fa2-628e-4abb-b6c2-cc7cfba5f233 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:18.055931 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cd125fa2-628e-4abb-b6c2-cc7cfba5f233 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:18.056649 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cd125fa2-628e-4abb-b6c2-cc7cfba5f233 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:18.057101 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cd125fa2-628e-4abb-b6c2-cc7cfba5f233 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:18.057519 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cd125fa2-628e-4abb-b6c2-cc7cfba5f233 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:18.198944 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-cd125fa2-628e-4abb-b6c2-cc7cfba5f233 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:18.209097 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-cd125fa2-628e-4abb-b6c2-cc7cfba5f233 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:18.210589 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-cd125fa2-628e-4abb-b6c2-cc7cfba5f233 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:18.211766 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-cd125fa2-628e-4abb-b6c2-cc7cfba5f233 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.169267 Aug 24 12:38:18.212314 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 348/699] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:18 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:19.235864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-944d02c4-bcd4-4e35-96e9-65c1a0e37522 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:19.236476 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-944d02c4-bcd4-4e35-96e9-65c1a0e37522 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:19.242843 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-944d02c4-bcd4-4e35-96e9-65c1a0e37522 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:19.243323 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-944d02c4-bcd4-4e35-96e9-65c1a0e37522 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:19.243793 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-944d02c4-bcd4-4e35-96e9-65c1a0e37522 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:19.244504 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-944d02c4-bcd4-4e35-96e9-65c1a0e37522 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:19.244956 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-944d02c4-bcd4-4e35-96e9-65c1a0e37522 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:19.245544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-944d02c4-bcd4-4e35-96e9-65c1a0e37522 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:19.377184 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-944d02c4-bcd4-4e35-96e9-65c1a0e37522 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:19.385140 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-944d02c4-bcd4-4e35-96e9-65c1a0e37522 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:19.386608 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-944d02c4-bcd4-4e35-96e9-65c1a0e37522 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:19.387762 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-944d02c4-bcd4-4e35-96e9-65c1a0e37522 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.156675 Aug 24 12:38:19.388310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 352/700] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:19 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:20.410105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-31d1c856-5e10-4a4b-9ed0-97a86a80c31e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:20.410711 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-31d1c856-5e10-4a4b-9ed0-97a86a80c31e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:20.417093 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31d1c856-5e10-4a4b-9ed0-97a86a80c31e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:20.417577 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31d1c856-5e10-4a4b-9ed0-97a86a80c31e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:20.418019 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31d1c856-5e10-4a4b-9ed0-97a86a80c31e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:20.419449 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31d1c856-5e10-4a4b-9ed0-97a86a80c31e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:20.419939 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31d1c856-5e10-4a4b-9ed0-97a86a80c31e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:20.420371 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31d1c856-5e10-4a4b-9ed0-97a86a80c31e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:20.438828 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:20.551817 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-31d1c856-5e10-4a4b-9ed0-97a86a80c31e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:20.560660 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-31d1c856-5e10-4a4b-9ed0-97a86a80c31e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:20.562311 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-31d1c856-5e10-4a4b-9ed0-97a86a80c31e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:20.563600 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-31d1c856-5e10-4a4b-9ed0-97a86a80c31e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.157411 Aug 24 12:38:20.564173 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 349/701] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:20 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:21.586363 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a35bb682-aef5-4c5e-aa7f-0dea9cf1f542 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:21.587022 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-a35bb682-aef5-4c5e-aa7f-0dea9cf1f542 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:21.594175 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a35bb682-aef5-4c5e-aa7f-0dea9cf1f542 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:21.594669 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a35bb682-aef5-4c5e-aa7f-0dea9cf1f542 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:21.595103 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a35bb682-aef5-4c5e-aa7f-0dea9cf1f542 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:21.595824 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a35bb682-aef5-4c5e-aa7f-0dea9cf1f542 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:21.596277 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a35bb682-aef5-4c5e-aa7f-0dea9cf1f542 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:21.596700 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a35bb682-aef5-4c5e-aa7f-0dea9cf1f542 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:21.729964 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-a35bb682-aef5-4c5e-aa7f-0dea9cf1f542 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:21.739367 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-a35bb682-aef5-4c5e-aa7f-0dea9cf1f542 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:21.741195 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-a35bb682-aef5-4c5e-aa7f-0dea9cf1f542 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:21.742449 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a35bb682-aef5-4c5e-aa7f-0dea9cf1f542 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.160061 Aug 24 12:38:21.757635 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 353/702] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:21 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:22.767191 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e23232b9-9e75-464d-9f2a-695186c89fa6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:22.767768 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e23232b9-9e75-464d-9f2a-695186c89fa6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:22.774253 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e23232b9-9e75-464d-9f2a-695186c89fa6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:22.774739 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e23232b9-9e75-464d-9f2a-695186c89fa6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:22.775175 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e23232b9-9e75-464d-9f2a-695186c89fa6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:22.775896 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e23232b9-9e75-464d-9f2a-695186c89fa6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:22.776356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e23232b9-9e75-464d-9f2a-695186c89fa6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:22.776779 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e23232b9-9e75-464d-9f2a-695186c89fa6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:22.918710 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e23232b9-9e75-464d-9f2a-695186c89fa6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:22.927492 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e23232b9-9e75-464d-9f2a-695186c89fa6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:22.929024 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e23232b9-9e75-464d-9f2a-695186c89fa6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:22.930174 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e23232b9-9e75-464d-9f2a-695186c89fa6 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.167557 Aug 24 12:38:22.931614 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 350/703] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:22 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:23.408071 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-9e09938d-aa96-4377-ae7c-59da69390fc0 req-33ff3101-2b98-4a53-b0be-25e4637db597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec78743-6cd7-4df3-a22c-72acff29cf1a", "name": "network-vif-plugged", "status": "completed", "tag": "50ca3644-951e-4983-8b1f-534cdf89c8cb"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:23.417390 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-9e09938d-aa96-4377-ae7c-59da69390fc0 req-33ff3101-2b98-4a53-b0be-25e4637db597 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.417869 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-9e09938d-aa96-4377-ae7c-59da69390fc0 req-33ff3101-2b98-4a53-b0be-25e4637db597 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.418298 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-9e09938d-aa96-4377-ae7c-59da69390fc0 req-33ff3101-2b98-4a53-b0be-25e4637db597 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:23.429167 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-9e09938d-aa96-4377-ae7c-59da69390fc0 req-33ff3101-2b98-4a53-b0be-25e4637db597 service nova] Creating event network-vif-plugged:50ca3644-951e-4983-8b1f-534cdf89c8cb for instance cec78743-6cd7-4df3-a22c-72acff29cf1a on hv-cinder-84890 Aug 24 12:38:23.434628 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-9e09938d-aa96-4377-ae7c-59da69390fc0 req-33ff3101-2b98-4a53-b0be-25e4637db597 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089227 Aug 24 12:38:23.435397 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 354/704] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:23.660755 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-dd36a238-8834-4302-b6d9-e1196d3a3351 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:23.661245 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-dd36a238-8834-4302-b6d9-e1196d3a3351 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:23.667594 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dd36a238-8834-4302-b6d9-e1196d3a3351 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.668123 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dd36a238-8834-4302-b6d9-e1196d3a3351 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.668668 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dd36a238-8834-4302-b6d9-e1196d3a3351 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:23.669671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dd36a238-8834-4302-b6d9-e1196d3a3351 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.670124 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dd36a238-8834-4302-b6d9-e1196d3a3351 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.670550 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dd36a238-8834-4302-b6d9-e1196d3a3351 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:23.694389 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-dd36a238-8834-4302-b6d9-e1196d3a3351 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/ips" status: 200 len: 150 microversion: 2.1 time: 0.148314 Aug 24 12:38:23.694979 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 351/705] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 12:38:23 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/ips => generated 150 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:23.966566 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-fed905d2-4796-450f-8bc5-cfbb8be25939 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:23.967273 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-fed905d2-4796-450f-8bc5-cfbb8be25939 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:23.973352 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fed905d2-4796-450f-8bc5-cfbb8be25939 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.973832 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fed905d2-4796-450f-8bc5-cfbb8be25939 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.974259 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fed905d2-4796-450f-8bc5-cfbb8be25939 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:23.974947 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fed905d2-4796-450f-8bc5-cfbb8be25939 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.975390 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fed905d2-4796-450f-8bc5-cfbb8be25939 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.975834 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fed905d2-4796-450f-8bc5-cfbb8be25939 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.113675 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-fed905d2-4796-450f-8bc5-cfbb8be25939 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:24.122643 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-fed905d2-4796-450f-8bc5-cfbb8be25939 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:24.124308 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-fed905d2-4796-450f-8bc5-cfbb8be25939 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:24.125458 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-fed905d2-4796-450f-8bc5-cfbb8be25939 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.175548 Aug 24 12:38:24.126012 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 355/706] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:23 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:24.458386 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3eab4fa8-6f05-4fad-92aa-62d6239de299 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:24.458949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3eab4fa8-6f05-4fad-92aa-62d6239de299 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:24.465268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3eab4fa8-6f05-4fad-92aa-62d6239de299 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.465999 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3eab4fa8-6f05-4fad-92aa-62d6239de299 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.466443 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3eab4fa8-6f05-4fad-92aa-62d6239de299 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.467141 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3eab4fa8-6f05-4fad-92aa-62d6239de299 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.467605 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3eab4fa8-6f05-4fad-92aa-62d6239de299 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.468057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3eab4fa8-6f05-4fad-92aa-62d6239de299 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.490503 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3eab4fa8-6f05-4fad-92aa-62d6239de299 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/ips" status: 200 len: 147 microversion: 2.1 time: 0.036011 Aug 24 12:38:24.491077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 352/707] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 12:38:24 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:25.031776 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-33d9bceb-d6e8-40ba-a70a-25d52c872d5c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff1aa63d-0d47-4bdc-9ee0-a9fc67b57a82"}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:25.034152 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-33d9bceb-d6e8-40ba-a70a-25d52c872d5c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:25.040489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-33d9bceb-d6e8-40ba-a70a-25d52c872d5c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.040996 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-33d9bceb-d6e8-40ba-a70a-25d52c872d5c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.041426 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-33d9bceb-d6e8-40ba-a70a-25d52c872d5c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:25.042111 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-33d9bceb-d6e8-40ba-a70a-25d52c872d5c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.042565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-33d9bceb-d6e8-40ba-a70a-25d52c872d5c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.042988 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-33d9bceb-d6e8-40ba-a70a-25d52c872d5c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:25.148588 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-dfd321fe-8cc7-4988-98c0-470ca3562e8a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:25.149164 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-dfd321fe-8cc7-4988-98c0-470ca3562e8a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:25.155711 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dfd321fe-8cc7-4988-98c0-470ca3562e8a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.156227 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dfd321fe-8cc7-4988-98c0-470ca3562e8a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.156668 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dfd321fe-8cc7-4988-98c0-470ca3562e8a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:25.157370 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dfd321fe-8cc7-4988-98c0-470ca3562e8a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.157832 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dfd321fe-8cc7-4988-98c0-470ca3562e8a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.158259 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dfd321fe-8cc7-4988-98c0-470ca3562e8a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:25.288704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-dfd321fe-8cc7-4988-98c0-470ca3562e8a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:25.297711 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-dfd321fe-8cc7-4988-98c0-470ca3562e8a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:25.299282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-dfd321fe-8cc7-4988-98c0-470ca3562e8a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:25.300471 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-dfd321fe-8cc7-4988-98c0-470ca3562e8a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.155837 Aug 24 12:38:25.301042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 353/708] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:25 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:25.703861 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-33d9bceb-d6e8-40ba-a70a-25d52c872d5c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "POST /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.676417 Aug 24 12:38:25.704532 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 356/709] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 12:38:25 2022] POST /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments => generated 194 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:25.831653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-7872de1f-d8b0-4ee0-a78e-1dfc47f5acc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0536b8b-b16a-4b22-8deb-f251b2836b4e"}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:25.834602 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-7872de1f-d8b0-4ee0-a78e-1dfc47f5acc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:25.840624 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7872de1f-d8b0-4ee0-a78e-1dfc47f5acc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.841255 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7872de1f-d8b0-4ee0-a78e-1dfc47f5acc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.841691 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7872de1f-d8b0-4ee0-a78e-1dfc47f5acc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:25.842393 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7872de1f-d8b0-4ee0-a78e-1dfc47f5acc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.842844 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7872de1f-d8b0-4ee0-a78e-1dfc47f5acc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.843264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7872de1f-d8b0-4ee0-a78e-1dfc47f5acc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:26.325938 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-691385a8-f5ce-4e00-b431-59c3280f9ef2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:26.326775 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-691385a8-f5ce-4e00-b431-59c3280f9ef2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:26.332899 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-691385a8-f5ce-4e00-b431-59c3280f9ef2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:26.333379 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-691385a8-f5ce-4e00-b431-59c3280f9ef2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:26.333808 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-691385a8-f5ce-4e00-b431-59c3280f9ef2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:26.334493 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-691385a8-f5ce-4e00-b431-59c3280f9ef2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:26.334939 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-691385a8-f5ce-4e00-b431-59c3280f9ef2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:26.335359 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-691385a8-f5ce-4e00-b431-59c3280f9ef2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:26.464137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-691385a8-f5ce-4e00-b431-59c3280f9ef2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:26.472651 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-691385a8-f5ce-4e00-b431-59c3280f9ef2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:26.474130 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-691385a8-f5ce-4e00-b431-59c3280f9ef2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:26.475275 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-691385a8-f5ce-4e00-b431-59c3280f9ef2 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.154663 Aug 24 12:38:26.475868 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 357/710] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:26 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:38:27.498773 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-80015b91-4649-4bdd-bbc3-a0e5620c4de8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:27.499516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-80015b91-4649-4bdd-bbc3-a0e5620c4de8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:27.505797 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-80015b91-4649-4bdd-bbc3-a0e5620c4de8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:27.506271 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-80015b91-4649-4bdd-bbc3-a0e5620c4de8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:27.506694 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-80015b91-4649-4bdd-bbc3-a0e5620c4de8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:27.507371 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-80015b91-4649-4bdd-bbc3-a0e5620c4de8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:27.507850 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-80015b91-4649-4bdd-bbc3-a0e5620c4de8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:27.508270 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-80015b91-4649-4bdd-bbc3-a0e5620c4de8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:27.639603 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-80015b91-4649-4bdd-bbc3-a0e5620c4de8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:27.648364 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-80015b91-4649-4bdd-bbc3-a0e5620c4de8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:27.649866 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-80015b91-4649-4bdd-bbc3-a0e5620c4de8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:27.651018 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-80015b91-4649-4bdd-bbc3-a0e5620c4de8 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.156165 Aug 24 12:38:27.651575 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 358/711] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:27 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:38:28.674306 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-8c38b5dd-248b-4e07-a5ec-49b60d9b84ff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:28.674980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-8c38b5dd-248b-4e07-a5ec-49b60d9b84ff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:28.677311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=43 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:28.683124 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8c38b5dd-248b-4e07-a5ec-49b60d9b84ff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:28.683603 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8c38b5dd-248b-4e07-a5ec-49b60d9b84ff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:28.684224 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8c38b5dd-248b-4e07-a5ec-49b60d9b84ff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:28.685029 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8c38b5dd-248b-4e07-a5ec-49b60d9b84ff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:28.685482 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8c38b5dd-248b-4e07-a5ec-49b60d9b84ff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:28.685905 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8c38b5dd-248b-4e07-a5ec-49b60d9b84ff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:28.828874 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-8c38b5dd-248b-4e07-a5ec-49b60d9b84ff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:28.838596 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-8c38b5dd-248b-4e07-a5ec-49b60d9b84ff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:28.840967 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-8c38b5dd-248b-4e07-a5ec-49b60d9b84ff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:28.842910 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-8c38b5dd-248b-4e07-a5ec-49b60d9b84ff tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1725 microversion: 2.20 time: 0.172421 Aug 24 12:38:28.844872 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 359/712] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:28 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:38:28.901796 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-7872de1f-d8b0-4ee0-a78e-1dfc47f5acc9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "POST /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.073767 Aug 24 12:38:28.903686 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 354/713] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 12:38:25 2022] POST /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments => generated 194 bytes in 3075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:29.866368 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-18abda05-5896-4d67-992a-9c21259a5bb3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:29.866973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-18abda05-5896-4d67-992a-9c21259a5bb3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:29.873818 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-18abda05-5896-4d67-992a-9c21259a5bb3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:29.874304 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-18abda05-5896-4d67-992a-9c21259a5bb3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:29.874738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-18abda05-5896-4d67-992a-9c21259a5bb3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:29.875430 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-18abda05-5896-4d67-992a-9c21259a5bb3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:29.875915 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-18abda05-5896-4d67-992a-9c21259a5bb3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:29.876394 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-18abda05-5896-4d67-992a-9c21259a5bb3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:30.023198 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-18abda05-5896-4d67-992a-9c21259a5bb3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:30.031507 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-18abda05-5896-4d67-992a-9c21259a5bb3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:30.033033 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-18abda05-5896-4d67-992a-9c21259a5bb3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:30.034164 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-18abda05-5896-4d67-992a-9c21259a5bb3 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1712 microversion: 2.20 time: 0.171756 Aug 24 12:38:30.034715 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 360/714] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:29 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1712 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:38.084560 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-93301293", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "networks": [{"uuid": "96243d03-54a0-41df-9dbd-05cde8397c1a"}]}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:38.094006 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:38.139784 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.network.neutron [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] validate_networks() for [('96243d03-54a0-41df-9dbd-05cde8397c1a', None, None, None, None, None)] {{(pid=127307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:38:38.499664 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Flavor limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:38:38.500180 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Image limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:38:38.500681 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Flavor pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:38:38.501097 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Image pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:38:38.501509 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:38:38.511217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:38.512404 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:38.512822 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:38.513553 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:38.514009 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:38.514429 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:38.531468 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Getting quotas for project 474008375491499b85702c8824bd1981. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:38:38.535483 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Getting quotas for user 9c40bc0027e94421a1da7b8016307b67 and project 474008375491499b85702c8824bd1981. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:38:38.546386 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Going to run 1 instances... {{(pid=127307) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:38:38.548797 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:38:38.594477 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0510e961-84ce-4567-b4c7-d539023abbd7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514127 Aug 24 12:38:38.595115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 355/715] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:38:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:38:38.605804 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-86439893-8802-4687-92ae-47bb5b909c4c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:38.606643 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-86439893-8802-4687-92ae-47bb5b909c4c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:38.663558 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-86439893-8802-4687-92ae-47bb5b909c4c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:38.670634 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-86439893-8802-4687-92ae-47bb5b909c4c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 200 len: 1217 microversion: 2.1 time: 0.068774 Aug 24 12:38:38.671194 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 361/716] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:38 2022] GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:39.691053 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9b64d042-3848-4b4f-ba6f-f18709f64ac9 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:39.691875 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-9b64d042-3848-4b4f-ba6f-f18709f64ac9 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:39.698394 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b64d042-3848-4b4f-ba6f-f18709f64ac9 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:39.698886 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b64d042-3848-4b4f-ba6f-f18709f64ac9 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:39.699946 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b64d042-3848-4b4f-ba6f-f18709f64ac9 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:39.700885 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b64d042-3848-4b4f-ba6f-f18709f64ac9 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:39.701335 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b64d042-3848-4b4f-ba6f-f18709f64ac9 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:39.701759 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9b64d042-3848-4b4f-ba6f-f18709f64ac9 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:39.775600 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-9b64d042-3848-4b4f-ba6f-f18709f64ac9 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:39.783987 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9b64d042-3848-4b4f-ba6f-f18709f64ac9 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 200 len: 1221 microversion: 2.1 time: 0.097178 Aug 24 12:38:39.784730 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 356/717] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:39 2022] GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 1221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:40.804861 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-bf6bef83-f0b1-4f5d-aff2-ce17cdbf17fd tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:40.805617 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-bf6bef83-f0b1-4f5d-aff2-ce17cdbf17fd tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:40.812029 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:40.814371 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bf6bef83-f0b1-4f5d-aff2-ce17cdbf17fd tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:40.815074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bf6bef83-f0b1-4f5d-aff2-ce17cdbf17fd tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:40.815568 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bf6bef83-f0b1-4f5d-aff2-ce17cdbf17fd tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.816360 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bf6bef83-f0b1-4f5d-aff2-ce17cdbf17fd tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:40.817111 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bf6bef83-f0b1-4f5d-aff2-ce17cdbf17fd tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:40.817596 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bf6bef83-f0b1-4f5d-aff2-ce17cdbf17fd tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.860238 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-227fd4ef-7f50-43e3-8d7d-8f46fef0621e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:40.860769 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-227fd4ef-7f50-43e3-8d7d-8f46fef0621e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:40.869743 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-227fd4ef-7f50-43e3-8d7d-8f46fef0621e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:40.870495 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-227fd4ef-7f50-43e3-8d7d-8f46fef0621e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:40.871518 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-227fd4ef-7f50-43e3-8d7d-8f46fef0621e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.872219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-227fd4ef-7f50-43e3-8d7d-8f46fef0621e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:40.872662 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-227fd4ef-7f50-43e3-8d7d-8f46fef0621e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:40.873254 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-227fd4ef-7f50-43e3-8d7d-8f46fef0621e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.900944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-bf6bef83-f0b1-4f5d-aff2-ce17cdbf17fd tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:40.913388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-bf6bef83-f0b1-4f5d-aff2-ce17cdbf17fd tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 200 len: 1275 microversion: 2.1 time: 0.112055 Aug 24 12:38:40.914290 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 362/718] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:40 2022] GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 1275 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:40.983181 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.objects.instance [None req-227fd4ef-7f50-43e3-8d7d-8f46fef0621e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lazy-loading 'services' on Instance uuid 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 {{(pid=127307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:38:41.078271 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-227fd4ef-7f50-43e3-8d7d-8f46fef0621e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "DELETE /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments/ff1aa63d-0d47-4bdc-9ee0-a9fc67b57a82" status: 202 len: 0 microversion: 2.1 time: 0.223232 Aug 24 12:38:41.079559 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 357/719] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 12:38:40 2022] DELETE /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments/ff1aa63d-0d47-4bdc-9ee0-a9fc67b57a82 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:38:41.087739 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f1fbc2d7-6794-416f-b7d7-763be3963a61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:41.090435 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f1fbc2d7-6794-416f-b7d7-763be3963a61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:41.096629 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1fbc2d7-6794-416f-b7d7-763be3963a61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:41.097328 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1fbc2d7-6794-416f-b7d7-763be3963a61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:41.097754 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1fbc2d7-6794-416f-b7d7-763be3963a61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:41.098615 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1fbc2d7-6794-416f-b7d7-763be3963a61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:41.099057 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1fbc2d7-6794-416f-b7d7-763be3963a61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:41.099500 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1fbc2d7-6794-416f-b7d7-763be3963a61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:41.129922 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f1fbc2d7-6794-416f-b7d7-763be3963a61 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046108 Aug 24 12:38:41.130477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 363/720] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:41 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:41.935306 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-bd5e1679-d3ff-47be-af83-44ff81746f54 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:41.935994 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-bd5e1679-d3ff-47be-af83-44ff81746f54 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:41.942200 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bd5e1679-d3ff-47be-af83-44ff81746f54 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:41.942754 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bd5e1679-d3ff-47be-af83-44ff81746f54 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:41.943251 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bd5e1679-d3ff-47be-af83-44ff81746f54 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:41.944040 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bd5e1679-d3ff-47be-af83-44ff81746f54 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:41.944550 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bd5e1679-d3ff-47be-af83-44ff81746f54 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:41.945213 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bd5e1679-d3ff-47be-af83-44ff81746f54 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.052864 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-e44a775e-6ee4-4b85-818c-2e9209a95911 req-5e71763c-54d3-4a9b-91ce-79599b1182e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a56fd4a9-d546-41d8-84f3-5131a8e40bc9", "tag": "767a0ee9-16a6-4a34-ba33-3bea6b5cb2b0"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:42.063730 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-e44a775e-6ee4-4b85-818c-2e9209a95911 req-5e71763c-54d3-4a9b-91ce-79599b1182e8 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.064211 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-e44a775e-6ee4-4b85-818c-2e9209a95911 req-5e71763c-54d3-4a9b-91ce-79599b1182e8 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.064643 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-e44a775e-6ee4-4b85-818c-2e9209a95911 req-5e71763c-54d3-4a9b-91ce-79599b1182e8 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.078310 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-e44a775e-6ee4-4b85-818c-2e9209a95911 req-5e71763c-54d3-4a9b-91ce-79599b1182e8 service nova] Creating event network-changed:767a0ee9-16a6-4a34-ba33-3bea6b5cb2b0 for instance a56fd4a9-d546-41d8-84f3-5131a8e40bc9 on hv-cinder-84890 Aug 24 12:38:42.083319 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-e44a775e-6ee4-4b85-818c-2e9209a95911 req-5e71763c-54d3-4a9b-91ce-79599b1182e8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180092 Aug 24 12:38:42.084442 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 358/721] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:42.104181 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-bd5e1679-d3ff-47be-af83-44ff81746f54 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:42.111887 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-bd5e1679-d3ff-47be-af83-44ff81746f54 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 200 len: 1317 microversion: 2.1 time: 0.181173 Aug 24 12:38:42.112452 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 364/722] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:41 2022] GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:42.143403 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d62c2759-d3ac-4f54-9c1b-c6e94d25fa31 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:42.145759 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d62c2759-d3ac-4f54-9c1b-c6e94d25fa31 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:42.152204 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d62c2759-d3ac-4f54-9c1b-c6e94d25fa31 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.153374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d62c2759-d3ac-4f54-9c1b-c6e94d25fa31 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.153813 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d62c2759-d3ac-4f54-9c1b-c6e94d25fa31 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.154506 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d62c2759-d3ac-4f54-9c1b-c6e94d25fa31 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.154962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d62c2759-d3ac-4f54-9c1b-c6e94d25fa31 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.155384 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d62c2759-d3ac-4f54-9c1b-c6e94d25fa31 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.184902 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d62c2759-d3ac-4f54-9c1b-c6e94d25fa31 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045839 Aug 24 12:38:42.185515 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 359/723] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:42 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:43.131452 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f880118d-ecfc-4d43-a589-9c0482cf4f44 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:43.132092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f880118d-ecfc-4d43-a589-9c0482cf4f44 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:43.138600 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f880118d-ecfc-4d43-a589-9c0482cf4f44 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:43.139091 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f880118d-ecfc-4d43-a589-9c0482cf4f44 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:43.139529 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f880118d-ecfc-4d43-a589-9c0482cf4f44 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:43.140254 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f880118d-ecfc-4d43-a589-9c0482cf4f44 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:43.140707 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f880118d-ecfc-4d43-a589-9c0482cf4f44 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:43.141127 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f880118d-ecfc-4d43-a589-9c0482cf4f44 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:43.197754 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-04dd0fb0-4a3d-49b1-a45e-75c5b8259e0f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:43.200076 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-04dd0fb0-4a3d-49b1-a45e-75c5b8259e0f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:43.206365 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-04dd0fb0-4a3d-49b1-a45e-75c5b8259e0f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:43.206857 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-04dd0fb0-4a3d-49b1-a45e-75c5b8259e0f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:43.207298 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-04dd0fb0-4a3d-49b1-a45e-75c5b8259e0f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:43.208110 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-04dd0fb0-4a3d-49b1-a45e-75c5b8259e0f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:43.208580 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-04dd0fb0-4a3d-49b1-a45e-75c5b8259e0f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:43.209198 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-04dd0fb0-4a3d-49b1-a45e-75c5b8259e0f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:43.239992 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-04dd0fb0-4a3d-49b1-a45e-75c5b8259e0f tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046592 Aug 24 12:38:43.240572 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 360/724] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:43 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:43.275389 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f880118d-ecfc-4d43-a589-9c0482cf4f44 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:43.283293 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f880118d-ecfc-4d43-a589-9c0482cf4f44 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 200 len: 1317 microversion: 2.1 time: 0.155709 Aug 24 12:38:43.283892 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 365/725] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:43 2022] GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:44.252487 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-24a10cef-3853-4fd0-845c-be3c83e6a33c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:44.254649 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-24a10cef-3853-4fd0-845c-be3c83e6a33c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:44.261044 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-24a10cef-3853-4fd0-845c-be3c83e6a33c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:44.261653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-24a10cef-3853-4fd0-845c-be3c83e6a33c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:44.262097 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-24a10cef-3853-4fd0-845c-be3c83e6a33c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:44.262786 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-24a10cef-3853-4fd0-845c-be3c83e6a33c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:44.263242 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-24a10cef-3853-4fd0-845c-be3c83e6a33c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:44.263702 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-24a10cef-3853-4fd0-845c-be3c83e6a33c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:44.293704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-24a10cef-3853-4fd0-845c-be3c83e6a33c tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045160 Aug 24 12:38:44.294263 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 361/726] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:44 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:44.303163 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e9a77340-f238-44e7-b30b-f91ecd1abcf2 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:44.303817 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e9a77340-f238-44e7-b30b-f91ecd1abcf2 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:44.310859 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e9a77340-f238-44e7-b30b-f91ecd1abcf2 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:44.311340 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e9a77340-f238-44e7-b30b-f91ecd1abcf2 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:44.311827 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e9a77340-f238-44e7-b30b-f91ecd1abcf2 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:44.312513 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e9a77340-f238-44e7-b30b-f91ecd1abcf2 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:44.312964 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e9a77340-f238-44e7-b30b-f91ecd1abcf2 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:44.313383 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e9a77340-f238-44e7-b30b-f91ecd1abcf2 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:44.444418 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e9a77340-f238-44e7-b30b-f91ecd1abcf2 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:44.453163 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e9a77340-f238-44e7-b30b-f91ecd1abcf2 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 200 len: 1317 microversion: 2.1 time: 0.153656 Aug 24 12:38:44.453712 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 366/727] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:44 2022] GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:45.305568 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6e029736-69b0-4103-a9b3-3b02a55e9f9e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:45.307977 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-6e029736-69b0-4103-a9b3-3b02a55e9f9e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:45.314631 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e029736-69b0-4103-a9b3-3b02a55e9f9e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.315124 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e029736-69b0-4103-a9b3-3b02a55e9f9e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.315559 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e029736-69b0-4103-a9b3-3b02a55e9f9e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.316280 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e029736-69b0-4103-a9b3-3b02a55e9f9e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.316732 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e029736-69b0-4103-a9b3-3b02a55e9f9e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.317152 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6e029736-69b0-4103-a9b3-3b02a55e9f9e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.348044 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-6e029736-69b0-4103-a9b3-3b02a55e9f9e tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046395 Aug 24 12:38:45.348621 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 362/728] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:45 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:45.422130 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-3e661dc2-c65a-42f2-bd90-476d189baafb req-fb8b91c3-f6dd-4ca7-81ea-386308c21dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56fd4a9-d546-41d8-84f3-5131a8e40bc9", "name": "network-vif-plugged", "status": "completed", "tag": "767a0ee9-16a6-4a34-ba33-3bea6b5cb2b0"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:45.432822 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-3e661dc2-c65a-42f2-bd90-476d189baafb req-fb8b91c3-f6dd-4ca7-81ea-386308c21dee service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.433185 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-3e661dc2-c65a-42f2-bd90-476d189baafb req-fb8b91c3-f6dd-4ca7-81ea-386308c21dee service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.434217 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-3e661dc2-c65a-42f2-bd90-476d189baafb req-fb8b91c3-f6dd-4ca7-81ea-386308c21dee service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.446449 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-3e661dc2-c65a-42f2-bd90-476d189baafb req-fb8b91c3-f6dd-4ca7-81ea-386308c21dee service nova] Creating event network-vif-plugged:767a0ee9-16a6-4a34-ba33-3bea6b5cb2b0 for instance a56fd4a9-d546-41d8-84f3-5131a8e40bc9 on hv-cinder-84890 Aug 24 12:38:45.453169 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-3e661dc2-c65a-42f2-bd90-476d189baafb req-fb8b91c3-f6dd-4ca7-81ea-386308c21dee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034294 Aug 24 12:38:45.453768 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 367/729] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:45.473967 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b351f9a6-47a8-4841-8577-1448068b26c0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:45.474841 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-b351f9a6-47a8-4841-8577-1448068b26c0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:45.481319 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b351f9a6-47a8-4841-8577-1448068b26c0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.481811 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b351f9a6-47a8-4841-8577-1448068b26c0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.482257 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b351f9a6-47a8-4841-8577-1448068b26c0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.482971 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b351f9a6-47a8-4841-8577-1448068b26c0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.483428 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b351f9a6-47a8-4841-8577-1448068b26c0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.483905 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b351f9a6-47a8-4841-8577-1448068b26c0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.617230 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b351f9a6-47a8-4841-8577-1448068b26c0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:45.625531 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b351f9a6-47a8-4841-8577-1448068b26c0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 200 len: 1317 microversion: 2.1 time: 0.155549 Aug 24 12:38:45.626101 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 363/730] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:45 2022] GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:46.361452 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-3a4d4cde-a57c-4ab3-bdb3-d8dc05124fcf tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:46.363726 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-3a4d4cde-a57c-4ab3-bdb3-d8dc05124fcf tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:46.369833 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3a4d4cde-a57c-4ab3-bdb3-d8dc05124fcf tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.370318 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3a4d4cde-a57c-4ab3-bdb3-d8dc05124fcf tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.370864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3a4d4cde-a57c-4ab3-bdb3-d8dc05124fcf tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.372100 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3a4d4cde-a57c-4ab3-bdb3-d8dc05124fcf tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.372551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3a4d4cde-a57c-4ab3-bdb3-d8dc05124fcf tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.372975 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3a4d4cde-a57c-4ab3-bdb3-d8dc05124fcf tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.404302 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-3a4d4cde-a57c-4ab3-bdb3-d8dc05124fcf tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047447 Aug 24 12:38:46.405107 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 368/731] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:46 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:46.646402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d6c0e926-1177-41c6-9c26-f18bdcdf9ecf tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:46.646936 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d6c0e926-1177-41c6-9c26-f18bdcdf9ecf tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:46.653953 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d6c0e926-1177-41c6-9c26-f18bdcdf9ecf tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.654436 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d6c0e926-1177-41c6-9c26-f18bdcdf9ecf tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.654872 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d6c0e926-1177-41c6-9c26-f18bdcdf9ecf tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.655564 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d6c0e926-1177-41c6-9c26-f18bdcdf9ecf tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.656045 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d6c0e926-1177-41c6-9c26-f18bdcdf9ecf tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.656489 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d6c0e926-1177-41c6-9c26-f18bdcdf9ecf tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.786226 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-d6c0e926-1177-41c6-9c26-f18bdcdf9ecf tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:46.794014 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d6c0e926-1177-41c6-9c26-f18bdcdf9ecf tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 200 len: 1317 microversion: 2.1 time: 0.151600 Aug 24 12:38:46.794584 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 364/732] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:46 2022] GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:47.110213 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-801077f4-9501-482e-bb1c-51ea43c8e7ae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:47.112398 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-801077f4-9501-482e-bb1c-51ea43c8e7ae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:47.119558 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-801077f4-9501-482e-bb1c-51ea43c8e7ae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.120081 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-801077f4-9501-482e-bb1c-51ea43c8e7ae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.120520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-801077f4-9501-482e-bb1c-51ea43c8e7ae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.121815 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-801077f4-9501-482e-bb1c-51ea43c8e7ae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.122272 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-801077f4-9501-482e-bb1c-51ea43c8e7ae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.122697 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-801077f4-9501-482e-bb1c-51ea43c8e7ae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.151780 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-801077f4-9501-482e-bb1c-51ea43c8e7ae tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046378 Aug 24 12:38:47.152343 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 369/733] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:47 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:47.162821 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8364eb0b-50c4-4926-9f1c-d400883bcbdc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:47.163305 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8364eb0b-50c4-4926-9f1c-d400883bcbdc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:47.169691 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8364eb0b-50c4-4926-9f1c-d400883bcbdc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.170169 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8364eb0b-50c4-4926-9f1c-d400883bcbdc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.170596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8364eb0b-50c4-4926-9f1c-d400883bcbdc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.171311 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8364eb0b-50c4-4926-9f1c-d400883bcbdc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.171794 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8364eb0b-50c4-4926-9f1c-d400883bcbdc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.172212 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8364eb0b-50c4-4926-9f1c-d400883bcbdc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.203396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8364eb0b-50c4-4926-9f1c-d400883bcbdc tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments/f0536b8b-b16a-4b22-8deb-f251b2836b4e" status: 200 len: 194 microversion: 2.1 time: 0.044488 Aug 24 12:38:47.204008 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 365/734] 10.222.0.58 () {58 vars in 1413 bytes} [Wed Aug 24 12:38:47 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments/f0536b8b-b16a-4b22-8deb-f251b2836b4e => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:47.416910 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e5c5a331-217d-424f-a6ba-8253179960fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:47.419700 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e5c5a331-217d-424f-a6ba-8253179960fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:47.431986 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e5c5a331-217d-424f-a6ba-8253179960fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.431986 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e5c5a331-217d-424f-a6ba-8253179960fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.431986 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e5c5a331-217d-424f-a6ba-8253179960fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.431986 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e5c5a331-217d-424f-a6ba-8253179960fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.432358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e5c5a331-217d-424f-a6ba-8253179960fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.432358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e5c5a331-217d-424f-a6ba-8253179960fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.460641 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e5c5a331-217d-424f-a6ba-8253179960fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048242 Aug 24 12:38:47.461211 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 370/735] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:47 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:47.815156 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e53f56a0-3907-45ec-86f6-48646d7f5906 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:47.815816 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e53f56a0-3907-45ec-86f6-48646d7f5906 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:47.822202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e53f56a0-3907-45ec-86f6-48646d7f5906 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.822695 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e53f56a0-3907-45ec-86f6-48646d7f5906 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.823138 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e53f56a0-3907-45ec-86f6-48646d7f5906 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.824548 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e53f56a0-3907-45ec-86f6-48646d7f5906 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.825329 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e53f56a0-3907-45ec-86f6-48646d7f5906 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.825789 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e53f56a0-3907-45ec-86f6-48646d7f5906 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.829844 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:47.956862 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e53f56a0-3907-45ec-86f6-48646d7f5906 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:47.965160 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e53f56a0-3907-45ec-86f6-48646d7f5906 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 200 len: 1507 microversion: 2.1 time: 0.153255 Aug 24 12:38:47.965716 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 366/736] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:47 2022] GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:48.473441 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9ac807e4-4586-47e3-acf0-9d9fca27bdb3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:48.475595 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9ac807e4-4586-47e3-acf0-9d9fca27bdb3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:48.481906 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ac807e4-4586-47e3-acf0-9d9fca27bdb3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.482382 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ac807e4-4586-47e3-acf0-9d9fca27bdb3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.482811 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ac807e4-4586-47e3-acf0-9d9fca27bdb3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.483496 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ac807e4-4586-47e3-acf0-9d9fca27bdb3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.483968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ac807e4-4586-47e3-acf0-9d9fca27bdb3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.484390 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ac807e4-4586-47e3-acf0-9d9fca27bdb3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.517072 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9ac807e4-4586-47e3-acf0-9d9fca27bdb3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047514 Aug 24 12:38:48.517655 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 371/737] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:48 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:38:48.547732 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ecb475ad-2e6d-4a1f-bdd4-f76dea94b8be tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c250adaa-7d6d-4474-8de3-ed18a6d479a2"}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:48.550141 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ecb475ad-2e6d-4a1f-bdd4-f76dea94b8be tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:48.552038 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:48.552695 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=6 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:48.559382 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ecb475ad-2e6d-4a1f-bdd4-f76dea94b8be tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.560012 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ecb475ad-2e6d-4a1f-bdd4-f76dea94b8be tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.560320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ecb475ad-2e6d-4a1f-bdd4-f76dea94b8be tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.561019 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ecb475ad-2e6d-4a1f-bdd4-f76dea94b8be tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.561476 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ecb475ad-2e6d-4a1f-bdd4-f76dea94b8be tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.561901 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ecb475ad-2e6d-4a1f-bdd4-f76dea94b8be tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.599316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d19edcb7-a650-42aa-9a9a-c5d133eb95b3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:48.599959 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d19edcb7-a650-42aa-9a9a-c5d133eb95b3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:48.607310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d19edcb7-a650-42aa-9a9a-c5d133eb95b3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.608173 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d19edcb7-a650-42aa-9a9a-c5d133eb95b3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.608605 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d19edcb7-a650-42aa-9a9a-c5d133eb95b3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.609446 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d19edcb7-a650-42aa-9a9a-c5d133eb95b3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.609770 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d19edcb7-a650-42aa-9a9a-c5d133eb95b3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.610216 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d19edcb7-a650-42aa-9a9a-c5d133eb95b3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.635614 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d19edcb7-a650-42aa-9a9a-c5d133eb95b3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Going to try to terminate instance {{(pid=127308) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:38:48.671312 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:48.722615 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d19edcb7-a650-42aa-9a9a-c5d133eb95b3 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "DELETE /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 204 len: 0 microversion: 2.1 time: 0.127163 Aug 24 12:38:48.723362 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 372/738] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:38:48 2022] DELETE /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:38:48.733999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c385e5b1-c7d0-4faf-a250-eaef1f133959 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:48.734703 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c385e5b1-c7d0-4faf-a250-eaef1f133959 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:48.740800 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c385e5b1-c7d0-4faf-a250-eaef1f133959 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.741352 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c385e5b1-c7d0-4faf-a250-eaef1f133959 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.741788 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c385e5b1-c7d0-4faf-a250-eaef1f133959 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.742489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c385e5b1-c7d0-4faf-a250-eaef1f133959 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.742927 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c385e5b1-c7d0-4faf-a250-eaef1f133959 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.743354 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c385e5b1-c7d0-4faf-a250-eaef1f133959 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.837814 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ecb475ad-2e6d-4a1f-bdd4-f76dea94b8be tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "POST /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294301 Aug 24 12:38:48.838372 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 367/739] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 12:38:48 2022] POST /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:48.901402 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c385e5b1-c7d0-4faf-a250-eaef1f133959 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:48.909950 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c385e5b1-c7d0-4faf-a250-eaef1f133959 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1682 microversion: 2.1 time: 0.181152 Aug 24 12:38:48.910514 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 373/740] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:48 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:38:49.932578 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-170366ff-a24a-41e6-b470-9996505dc921 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:49.933965 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-170366ff-a24a-41e6-b470-9996505dc921 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:49.942057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-170366ff-a24a-41e6-b470-9996505dc921 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:49.943013 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-170366ff-a24a-41e6-b470-9996505dc921 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:49.943560 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-170366ff-a24a-41e6-b470-9996505dc921 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:49.944395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-170366ff-a24a-41e6-b470-9996505dc921 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:49.945436 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-170366ff-a24a-41e6-b470-9996505dc921 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:49.945914 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-170366ff-a24a-41e6-b470-9996505dc921 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:50.081108 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-170366ff-a24a-41e6-b470-9996505dc921 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:50.088769 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-170366ff-a24a-41e6-b470-9996505dc921 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1682 microversion: 2.1 time: 0.162067 Aug 24 12:38:50.089797 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 368/741] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:49 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:51.111776 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-75cbbd04-28b0-4b89-8ae0-d59f478c1f15 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:51.113296 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-75cbbd04-28b0-4b89-8ae0-d59f478c1f15 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:51.120456 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-75cbbd04-28b0-4b89-8ae0-d59f478c1f15 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:51.121120 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-75cbbd04-28b0-4b89-8ae0-d59f478c1f15 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:51.121652 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-75cbbd04-28b0-4b89-8ae0-d59f478c1f15 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:51.123155 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-75cbbd04-28b0-4b89-8ae0-d59f478c1f15 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:51.123963 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-75cbbd04-28b0-4b89-8ae0-d59f478c1f15 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:51.124688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-75cbbd04-28b0-4b89-8ae0-d59f478c1f15 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:51.193561 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-75cbbd04-28b0-4b89-8ae0-d59f478c1f15 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa753d1e2c4430498d5b28f0304952f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a2fec602684ab1a454b8da589b4787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:51.202708 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-75cbbd04-28b0-4b89-8ae0-d59f478c1f15 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 200 len: 1614 microversion: 2.1 time: 0.095083 Aug 24 12:38:51.203301 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 374/742] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:51 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 1614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:51.475894 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-0a4b9f4e-3222-4f5a-8f83-d011040310fe req-51671b70-0a57-4b2e-949c-8b94476d240a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812d57c7-7fbf-4d11-bc76-a23e9ae9f394", "name": "network-vif-deleted", "tag": "10113451-b2c5-4e51-a5e5-9b48dbc8798e"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:51.487302 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-0a4b9f4e-3222-4f5a-8f83-d011040310fe req-51671b70-0a57-4b2e-949c-8b94476d240a service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:51.487829 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-0a4b9f4e-3222-4f5a-8f83-d011040310fe req-51671b70-0a57-4b2e-949c-8b94476d240a service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:51.488324 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-0a4b9f4e-3222-4f5a-8f83-d011040310fe req-51671b70-0a57-4b2e-949c-8b94476d240a service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:51.500866 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-0a4b9f4e-3222-4f5a-8f83-d011040310fe req-51671b70-0a57-4b2e-949c-8b94476d240a service nova] Creating event network-vif-deleted:10113451-b2c5-4e51-a5e5-9b48dbc8798e for instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 on hv-cinder-84890 Aug 24 12:38:51.506819 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-0a4b9f4e-3222-4f5a-8f83-d011040310fe req-51671b70-0a57-4b2e-949c-8b94476d240a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034257 Aug 24 12:38:51.508050 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 369/743] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:52.224452 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-edcbeea0-e076-457f-99ee-de5dd134aa27 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:52.225060 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-edcbeea0-e076-457f-99ee-de5dd134aa27 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:52.232040 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-edcbeea0-e076-457f-99ee-de5dd134aa27 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:52.232750 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-edcbeea0-e076-457f-99ee-de5dd134aa27 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:52.233140 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-edcbeea0-e076-457f-99ee-de5dd134aa27 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:52.233834 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-edcbeea0-e076-457f-99ee-de5dd134aa27 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:52.234323 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-edcbeea0-e076-457f-99ee-de5dd134aa27 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:52.234689 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-edcbeea0-e076-457f-99ee-de5dd134aa27 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:52.248050 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-edcbeea0-e076-457f-99ee-de5dd134aa27 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] HTTP exception thrown: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-edcbeea0-e076-457f-99ee-de5dd134aa27 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Request method failure captured: Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 HTTP/1.1 Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhptX0YqROqNx9UwMblZH009WKCG7BL_aq4XeZf5ruCxnINLTbZjkM1uY9mAwjGHDX4uNPq1GuTB3ldLiiOiheC0oM9d1taj1Dr9v5q40AFD6MPcStG0igxeq4w-WcOLdJxPRTIIrqfH6xB1-wHZLVNdeJomT9Bmh01X6Epb9BGxpj8 Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:38:52.249695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:38:52.251285 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:38:52.251285 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:52.251285 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:52.251285 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:52.251285 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:52.251285 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:38:52.251285 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:38:52.251285 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 9aa753d1e2c4430498d5b28f0304952f Aug 24 12:38:52.251285 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:52.251285 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:38:52.251285 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. Aug 24 12:38:52.251285 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '812d57c7-7fbf-4d11-bc76-a23e9ae9f394'} Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:52.252377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. Aug 24 12:38:52.254310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:52.256440 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-edcbeea0-e076-457f-99ee-de5dd134aa27 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Returning 404 to user: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:52.256440 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-edcbeea0-e076-457f-99ee-de5dd134aa27 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 404 len: 111 microversion: 2.1 time: 0.030449 Aug 24 12:38:52.256440 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 375/744] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:52 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:38:52.261508 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2ad4e81f-46f8-4985-9fa5-d4381e1ff3f1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '.version_select at 0x7f46973655e0>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:52.285784 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2ad4e81f-46f8-4985-9fa5-d4381e1ff3f1 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132293919" status: 202 len: 0 microversion: 2.1 time: 0.028847 Aug 24 12:38:52.286378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 370/745] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 24 12:38:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132293919 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:38:54.066690 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7e32ee0a-e9bd-4d24-9c4c-1bec3fe403b6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:54.067371 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-7e32ee0a-e9bd-4d24-9c4c-1bec3fe403b6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:54.074489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e32ee0a-e9bd-4d24-9c4c-1bec3fe403b6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:54.075524 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e32ee0a-e9bd-4d24-9c4c-1bec3fe403b6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:54.076005 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e32ee0a-e9bd-4d24-9c4c-1bec3fe403b6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:54.076715 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e32ee0a-e9bd-4d24-9c4c-1bec3fe403b6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:54.077163 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e32ee0a-e9bd-4d24-9c4c-1bec3fe403b6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:54.077584 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e32ee0a-e9bd-4d24-9c4c-1bec3fe403b6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:54.091816 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-7e32ee0a-e9bd-4d24-9c4c-1bec3fe403b6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] HTTP exception thrown: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7e32ee0a-e9bd-4d24-9c4c-1bec3fe403b6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Request method failure captured: Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: DELETE /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 HTTP/1.1 Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhptX0YqROqNx9UwMblZH009WKCG7BL_aq4XeZf5ruCxnINLTbZjkM1uY9mAwjGHDX4uNPq1GuTB3ldLiiOiheC0oM9d1taj1Dr9v5q40AFD6MPcStG0igxeq4w-WcOLdJxPRTIIrqfH6xB1-wHZLVNdeJomT9Bmh01X6Epb9BGxpj8 Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:38:54.093381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:38:54.095031 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:38:54.095031 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:54.095031 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:54.095031 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:54.095031 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:54.095031 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:38:54.095031 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:38:54.095031 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 9aa753d1e2c4430498d5b28f0304952f Aug 24 12:38:54.095031 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:54.095031 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:38:54.095031 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. Aug 24 12:38:54.095031 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '812d57c7-7fbf-4d11-bc76-a23e9ae9f394'} Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:54.095958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. Aug 24 12:38:54.097442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:54.098910 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7e32ee0a-e9bd-4d24-9c4c-1bec3fe403b6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Returning 404 to user: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:54.098910 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-7e32ee0a-e9bd-4d24-9c4c-1bec3fe403b6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "DELETE /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 404 len: 111 microversion: 2.1 time: 0.032318 Aug 24 12:38:54.098910 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 376/746] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:38:54 2022] DELETE /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:38:54.108169 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-464268c7-acef-4098-b8ca-0e839fd91aeb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:54.109501 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-464268c7-acef-4098-b8ca-0e839fd91aeb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 812d57c7-7fbf-4d11-bc76-a23e9ae9f394] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:54.118982 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-464268c7-acef-4098-b8ca-0e839fd91aeb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:54.119464 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-464268c7-acef-4098-b8ca-0e839fd91aeb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:54.119922 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-464268c7-acef-4098-b8ca-0e839fd91aeb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:54.120750 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-464268c7-acef-4098-b8ca-0e839fd91aeb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:54.122537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-464268c7-acef-4098-b8ca-0e839fd91aeb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:54.122537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-464268c7-acef-4098-b8ca-0e839fd91aeb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:54.135288 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-464268c7-acef-4098-b8ca-0e839fd91aeb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] HTTP exception thrown: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-464268c7-acef-4098-b8ca-0e839fd91aeb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Request method failure captured: Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 HTTP/1.1 Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhptX0YqROqNx9UwMblZH009WKCG7BL_aq4XeZf5ruCxnINLTbZjkM1uY9mAwjGHDX4uNPq1GuTB3ldLiiOiheC0oM9d1taj1Dr9v5q40AFD6MPcStG0igxeq4w-WcOLdJxPRTIIrqfH6xB1-wHZLVNdeJomT9Bmh01X6Epb9BGxpj8 Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:38:54.136981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:38:54.139030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:38:54.139030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:54.139030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:54.139030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:54.139030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:54.139030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:38:54.139030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:38:54.139030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 9aa753d1e2c4430498d5b28f0304952f Aug 24 12:38:54.139030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:54.139030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:38:54.139030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. Aug 24 12:38:54.139030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': '812d57c7-7fbf-4d11-bc76-a23e9ae9f394'} Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:54.140027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. Aug 24 12:38:54.141465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:54.142771 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-464268c7-acef-4098-b8ca-0e839fd91aeb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Returning 404 to user: Instance 812d57c7-7fbf-4d11-bc76-a23e9ae9f394 could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:54.142771 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-464268c7-acef-4098-b8ca-0e839fd91aeb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394" status: 404 len: 111 microversion: 2.1 time: 0.039093 Aug 24 12:38:54.142771 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 371/747] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:54 2022] GET /compute/v2.1/servers/812d57c7-7fbf-4d11-bc76-a23e9ae9f394 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:38:55.294120 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2fb7b0da-5dc6-4de4-9645-bd81eee5ebc4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:55.295188 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2fb7b0da-5dc6-4de4-9645-bd81eee5ebc4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:55.301537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2fb7b0da-5dc6-4de4-9645-bd81eee5ebc4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.302017 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2fb7b0da-5dc6-4de4-9645-bd81eee5ebc4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.302456 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2fb7b0da-5dc6-4de4-9645-bd81eee5ebc4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.303140 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2fb7b0da-5dc6-4de4-9645-bd81eee5ebc4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.303591 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2fb7b0da-5dc6-4de4-9645-bd81eee5ebc4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.304041 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2fb7b0da-5dc6-4de4-9645-bd81eee5ebc4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.317666 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-2fb7b0da-5dc6-4de4-9645-bd81eee5ebc4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] HTTP exception thrown: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2fb7b0da-5dc6-4de4-9645-bd81eee5ebc4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Request method failure captured: Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: DELETE /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de HTTP/1.1 Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhptX0YqROqNx9UwMblZH009WKCG7BL_aq4XeZf5ruCxnINLTbZjkM1uY9mAwjGHDX4uNPq1GuTB3ldLiiOiheC0oM9d1taj1Dr9v5q40AFD6MPcStG0igxeq4w-WcOLdJxPRTIIrqfH6xB1-wHZLVNdeJomT9Bmh01X6Epb9BGxpj8 Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:38:55.319176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:38:55.320755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:38:55.320755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:55.320755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:55.320755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:55.320755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:55.320755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:38:55.320755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:38:55.320755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 9aa753d1e2c4430498d5b28f0304952f Aug 24 12:38:55.320755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:55.320755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:38:55.320755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. Aug 24 12:38:55.320755 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '871692ae-90bf-465a-ba88-24cfd077e5de'} Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:55.321639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. Aug 24 12:38:55.323225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.324663 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2fb7b0da-5dc6-4de4-9645-bd81eee5ebc4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Returning 404 to user: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:55.324663 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2fb7b0da-5dc6-4de4-9645-bd81eee5ebc4 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "DELETE /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 404 len: 111 microversion: 2.1 time: 0.030873 Aug 24 12:38:55.324663 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 377/748] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:38:55 2022] DELETE /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:38:55.329542 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-4d16c000-1131-481b-9d62-2ca9074b43fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:55.330160 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-4d16c000-1131-481b-9d62-2ca9074b43fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 871692ae-90bf-465a-ba88-24cfd077e5de] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:55.336549 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4d16c000-1131-481b-9d62-2ca9074b43fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.337044 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4d16c000-1131-481b-9d62-2ca9074b43fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.337463 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4d16c000-1131-481b-9d62-2ca9074b43fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.338148 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4d16c000-1131-481b-9d62-2ca9074b43fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.338626 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4d16c000-1131-481b-9d62-2ca9074b43fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.339046 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4d16c000-1131-481b-9d62-2ca9074b43fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.352454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-4d16c000-1131-481b-9d62-2ca9074b43fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] HTTP exception thrown: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-4d16c000-1131-481b-9d62-2ca9074b43fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Request method failure captured: Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de HTTP/1.1 Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhptX0YqROqNx9UwMblZH009WKCG7BL_aq4XeZf5ruCxnINLTbZjkM1uY9mAwjGHDX4uNPq1GuTB3ldLiiOiheC0oM9d1taj1Dr9v5q40AFD6MPcStG0igxeq4w-WcOLdJxPRTIIrqfH6xB1-wHZLVNdeJomT9Bmh01X6Epb9BGxpj8 Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:38:55.353947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:38:55.355479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:38:55.355479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:55.355479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:55.355479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:55.355479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:55.355479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:38:55.355479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:38:55.355479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 9aa753d1e2c4430498d5b28f0304952f Aug 24 12:38:55.355479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:55.355479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:38:55.355479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. Aug 24 12:38:55.355479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': '871692ae-90bf-465a-ba88-24cfd077e5de'} Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:55.356445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. Aug 24 12:38:55.358411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.359856 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-4d16c000-1131-481b-9d62-2ca9074b43fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Returning 404 to user: Instance 871692ae-90bf-465a-ba88-24cfd077e5de could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:55.359856 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-4d16c000-1131-481b-9d62-2ca9074b43fb tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de" status: 404 len: 111 microversion: 2.1 time: 0.029937 Aug 24 12:38:55.359856 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 372/749] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:55 2022] GET /compute/v2.1/servers/871692ae-90bf-465a-ba88-24cfd077e5de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:38:55.364275 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7e9f3293-1c2b-4a3c-b512-10a4fac812d6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:55.364768 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-7e9f3293-1c2b-4a3c-b512-10a4fac812d6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:55.370736 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e9f3293-1c2b-4a3c-b512-10a4fac812d6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.371222 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e9f3293-1c2b-4a3c-b512-10a4fac812d6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.371682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e9f3293-1c2b-4a3c-b512-10a4fac812d6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.372369 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e9f3293-1c2b-4a3c-b512-10a4fac812d6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.373464 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e9f3293-1c2b-4a3c-b512-10a4fac812d6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.373882 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7e9f3293-1c2b-4a3c-b512-10a4fac812d6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.386962 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-7e9f3293-1c2b-4a3c-b512-10a4fac812d6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] HTTP exception thrown: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7e9f3293-1c2b-4a3c-b512-10a4fac812d6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Request method failure captured: Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: DELETE /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b HTTP/1.1 Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhptX0YqROqNx9UwMblZH009WKCG7BL_aq4XeZf5ruCxnINLTbZjkM1uY9mAwjGHDX4uNPq1GuTB3ldLiiOiheC0oM9d1taj1Dr9v5q40AFD6MPcStG0igxeq4w-WcOLdJxPRTIIrqfH6xB1-wHZLVNdeJomT9Bmh01X6Epb9BGxpj8 Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:38:55.388609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:38:55.390238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:38:55.390238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:55.390238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:55.390238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:55.390238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:55.390238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:38:55.390238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:38:55.390238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 9aa753d1e2c4430498d5b28f0304952f Aug 24 12:38:55.390238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:55.390238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:38:55.390238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. Aug 24 12:38:55.390238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '32a53b53-99f8-423a-b3f2-67416a5a323b'} Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:55.391145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. Aug 24 12:38:55.392705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.394254 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7e9f3293-1c2b-4a3c-b512-10a4fac812d6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Returning 404 to user: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:55.394254 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-7e9f3293-1c2b-4a3c-b512-10a4fac812d6 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "DELETE /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 404 len: 111 microversion: 2.1 time: 0.029527 Aug 24 12:38:55.394254 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 378/750] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:38:55 2022] DELETE /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 12:38:55.398005 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-59be3d9e-a2b4-4ea8-9fed-3010cc50f6f8 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:55.398624 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-59be3d9e-a2b4-4ea8-9fed-3010cc50f6f8 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 32a53b53-99f8-423a-b3f2-67416a5a323b] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:55.404625 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-59be3d9e-a2b4-4ea8-9fed-3010cc50f6f8 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.405106 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-59be3d9e-a2b4-4ea8-9fed-3010cc50f6f8 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.405546 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-59be3d9e-a2b4-4ea8-9fed-3010cc50f6f8 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.406234 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-59be3d9e-a2b4-4ea8-9fed-3010cc50f6f8 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.406690 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-59be3d9e-a2b4-4ea8-9fed-3010cc50f6f8 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.407114 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-59be3d9e-a2b4-4ea8-9fed-3010cc50f6f8 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.420999 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-59be3d9e-a2b4-4ea8-9fed-3010cc50f6f8 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] HTTP exception thrown: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-59be3d9e-a2b4-4ea8-9fed-3010cc50f6f8 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Request method failure captured: Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b HTTP/1.1 Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhptX0YqROqNx9UwMblZH009WKCG7BL_aq4XeZf5ruCxnINLTbZjkM1uY9mAwjGHDX4uNPq1GuTB3ldLiiOiheC0oM9d1taj1Dr9v5q40AFD6MPcStG0igxeq4w-WcOLdJxPRTIIrqfH6xB1-wHZLVNdeJomT9Bmh01X6Epb9BGxpj8 Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:38:55.422500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:38:55.424146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:38:55.424146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:55.424146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:55.424146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:55.424146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:55.424146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:38:55.424146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:38:55.424146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 9aa753d1e2c4430498d5b28f0304952f Aug 24 12:38:55.424146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:55.424146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:38:55.424146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. Aug 24 12:38:55.424146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': '32a53b53-99f8-423a-b3f2-67416a5a323b'} Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:55.425078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. Aug 24 12:38:55.426541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:55.427893 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-59be3d9e-a2b4-4ea8-9fed-3010cc50f6f8 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Returning 404 to user: Instance 32a53b53-99f8-423a-b3f2-67416a5a323b could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:55.427893 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-59be3d9e-a2b4-4ea8-9fed-3010cc50f6f8 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b" status: 404 len: 111 microversion: 2.1 time: 0.029476 Aug 24 12:38:55.427893 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 373/751] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:55 2022] GET /compute/v2.1/servers/32a53b53-99f8-423a-b3f2-67416a5a323b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:38:56.566804 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b85971aa-f9b3-4dc3-bb32-29f7e9d5d759 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:56.567415 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b85971aa-f9b3-4dc3-bb32-29f7e9d5d759 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:56.574866 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b85971aa-f9b3-4dc3-bb32-29f7e9d5d759 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:56.576300 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b85971aa-f9b3-4dc3-bb32-29f7e9d5d759 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:56.576781 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b85971aa-f9b3-4dc3-bb32-29f7e9d5d759 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:56.577626 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b85971aa-f9b3-4dc3-bb32-29f7e9d5d759 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:56.578139 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b85971aa-f9b3-4dc3-bb32-29f7e9d5d759 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:56.578587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b85971aa-f9b3-4dc3-bb32-29f7e9d5d759 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:56.593182 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-b85971aa-f9b3-4dc3-bb32-29f7e9d5d759 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] HTTP exception thrown: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b85971aa-f9b3-4dc3-bb32-29f7e9d5d759 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Request method failure captured: Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: DELETE /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda HTTP/1.1 Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhptX0YqROqNx9UwMblZH009WKCG7BL_aq4XeZf5ruCxnINLTbZjkM1uY9mAwjGHDX4uNPq1GuTB3ldLiiOiheC0oM9d1taj1Dr9v5q40AFD6MPcStG0igxeq4w-WcOLdJxPRTIIrqfH6xB1-wHZLVNdeJomT9Bmh01X6Epb9BGxpj8 Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:38:56.594753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:38:56.596372 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:38:56.596372 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:56.596372 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:56.596372 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:56.596372 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:56.596372 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:38:56.596372 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:38:56.596372 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 9aa753d1e2c4430498d5b28f0304952f Aug 24 12:38:56.596372 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:56.596372 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:38:56.596372 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. Aug 24 12:38:56.596372 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '3b5f3300-5ec6-4d3e-b94b-23041ffe7bda'} Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:56.597199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. Aug 24 12:38:56.598523 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:38:56.599790 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b85971aa-f9b3-4dc3-bb32-29f7e9d5d759 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Returning 404 to user: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:56.599790 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b85971aa-f9b3-4dc3-bb32-29f7e9d5d759 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 404 len: 111 microversion: 2.1 time: 0.033926 Aug 24 12:38:56.599790 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 379/752] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:38:56 2022] DELETE /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:38:56.604625 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-cdffb642-3084-4e50-a5c9-c3be7e4d5885 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:56.605269 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-cdffb642-3084-4e50-a5c9-c3be7e4d5885 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] [instance: 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:56.611584 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cdffb642-3084-4e50-a5c9-c3be7e4d5885 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:56.612119 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cdffb642-3084-4e50-a5c9-c3be7e4d5885 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:56.612541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cdffb642-3084-4e50-a5c9-c3be7e4d5885 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:56.613217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cdffb642-3084-4e50-a5c9-c3be7e4d5885 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:56.613665 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cdffb642-3084-4e50-a5c9-c3be7e4d5885 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:56.614081 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-cdffb642-3084-4e50-a5c9-c3be7e4d5885 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:56.627678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-cdffb642-3084-4e50-a5c9-c3be7e4d5885 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] HTTP exception thrown: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-cdffb642-3084-4e50-a5c9-c3be7e4d5885 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Request method failure captured: Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda HTTP/1.1 Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhptX0YqROqNx9UwMblZH009WKCG7BL_aq4XeZf5ruCxnINLTbZjkM1uY9mAwjGHDX4uNPq1GuTB3ldLiiOiheC0oM9d1taj1Dr9v5q40AFD6MPcStG0igxeq4w-WcOLdJxPRTIIrqfH6xB1-wHZLVNdeJomT9Bmh01X6Epb9BGxpj8 Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:38:56.629170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:38:56.630749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a2fec602684ab1a454b8da589b4787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:38:56.630749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:56.630749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: f3a2fec602684ab1a454b8da589b4787 Aug 24 12:38:56.630749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1819890610 Aug 24 12:38:56.630749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:56.630749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:38:56.630749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:38:56.630749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 9aa753d1e2c4430498d5b28f0304952f Aug 24 12:38:56.630749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeNegativeTest-1819890610-project Aug 24 12:38:56.630749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:38:56.630749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. Aug 24 12:38:56.630749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': '3b5f3300-5ec6-4d3e-b94b-23041ffe7bda'} Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:56.631639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. Aug 24 12:38:56.633115 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:38:56.634454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-cdffb642-3084-4e50-a5c9-c3be7e4d5885 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] Returning 404 to user: Instance 3b5f3300-5ec6-4d3e-b94b-23041ffe7bda could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:56.634454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-cdffb642-3084-4e50-a5c9-c3be7e4d5885 tempest-AttachVolumeNegativeTest-1819890610 tempest-AttachVolumeNegativeTest-1819890610-project] 10.222.0.58 "GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda" status: 404 len: 111 microversion: 2.1 time: 0.029645 Aug 24 12:38:56.634454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 374/753] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:56 2022] GET /compute/v2.1/servers/3b5f3300-5ec6-4d3e-b94b-23041ffe7bda => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:38:57.452571 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e38c8a23-11ee-491d-b4f6-1576ff70e9b7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:57.454710 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e38c8a23-11ee-491d-b4f6-1576ff70e9b7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:57.460594 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e38c8a23-11ee-491d-b4f6-1576ff70e9b7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.461076 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e38c8a23-11ee-491d-b4f6-1576ff70e9b7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.461504 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e38c8a23-11ee-491d-b4f6-1576ff70e9b7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.462219 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e38c8a23-11ee-491d-b4f6-1576ff70e9b7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.462670 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e38c8a23-11ee-491d-b4f6-1576ff70e9b7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.463087 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e38c8a23-11ee-491d-b4f6-1576ff70e9b7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.491368 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:57.497107 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e38c8a23-11ee-491d-b4f6-1576ff70e9b7 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048887 Aug 24 12:38:57.502899 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 380/754] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:57 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:57.647187 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-262c036e-b875-41be-8adf-db5f5491f66d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:57.647744 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-262c036e-b875-41be-8adf-db5f5491f66d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:57.655758 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-262c036e-b875-41be-8adf-db5f5491f66d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.656268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-262c036e-b875-41be-8adf-db5f5491f66d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.656704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-262c036e-b875-41be-8adf-db5f5491f66d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.657422 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-262c036e-b875-41be-8adf-db5f5491f66d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.657874 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-262c036e-b875-41be-8adf-db5f5491f66d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.658331 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-262c036e-b875-41be-8adf-db5f5491f66d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.687671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-262c036e-b875-41be-8adf-db5f5491f66d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments/f0536b8b-b16a-4b22-8deb-f251b2836b4e" status: 200 len: 194 microversion: 2.1 time: 0.044359 Aug 24 12:38:57.688508 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 375/755] 10.222.0.58 () {58 vars in 1413 bytes} [Wed Aug 24 12:38:57 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments/f0536b8b-b16a-4b22-8deb-f251b2836b4e => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:57.698756 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b62dffb1-cfad-44a6-b492-611de1195cef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:57.699321 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b62dffb1-cfad-44a6-b492-611de1195cef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:57.707429 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b62dffb1-cfad-44a6-b492-611de1195cef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.708391 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b62dffb1-cfad-44a6-b492-611de1195cef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.708903 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b62dffb1-cfad-44a6-b492-611de1195cef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.709699 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b62dffb1-cfad-44a6-b492-611de1195cef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.710223 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b62dffb1-cfad-44a6-b492-611de1195cef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.710715 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b62dffb1-cfad-44a6-b492-611de1195cef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.798229 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-b62dffb1-cfad-44a6-b492-611de1195cef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lazy-loading 'services' on Instance uuid 43372cd4-ec10-4467-a0e3-c7b1d44dc50e {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:38:57.898211 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b62dffb1-cfad-44a6-b492-611de1195cef tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments/f0536b8b-b16a-4b22-8deb-f251b2836b4e" status: 202 len: 0 microversion: 2.1 time: 0.202638 Aug 24 12:38:57.899002 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 381/756] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 12:38:57 2022] DELETE /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments/f0536b8b-b16a-4b22-8deb-f251b2836b4e => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:38:59.062834 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-973e1471-0887-4ef9-8cca-610b398ddcd0 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:59.063467 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-973e1471-0887-4ef9-8cca-610b398ddcd0 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:59.070690 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-973e1471-0887-4ef9-8cca-610b398ddcd0 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:59.071397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-973e1471-0887-4ef9-8cca-610b398ddcd0 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:59.071956 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-973e1471-0887-4ef9-8cca-610b398ddcd0 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:59.072768 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-973e1471-0887-4ef9-8cca-610b398ddcd0 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:59.073306 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-973e1471-0887-4ef9-8cca-610b398ddcd0 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:59.073808 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-973e1471-0887-4ef9-8cca-610b398ddcd0 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:59.104952 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-973e1471-0887-4ef9-8cca-610b398ddcd0 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments/c250adaa-7d6d-4474-8de3-ed18a6d479a2" status: 200 len: 194 microversion: 2.1 time: 0.047581 Aug 24 12:38:59.105673 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 376/757] 10.222.0.58 () {58 vars in 1413 bytes} [Wed Aug 24 12:38:59 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments/c250adaa-7d6d-4474-8de3-ed18a6d479a2 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:59.117898 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-386c2e2a-6e34-4a36-ac94-a96855ab9688 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:59.118470 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-386c2e2a-6e34-4a36-ac94-a96855ab9688 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:59.120392 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:59.126662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-386c2e2a-6e34-4a36-ac94-a96855ab9688 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:59.127084 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-386c2e2a-6e34-4a36-ac94-a96855ab9688 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:59.127510 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-386c2e2a-6e34-4a36-ac94-a96855ab9688 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:59.128224 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-386c2e2a-6e34-4a36-ac94-a96855ab9688 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:59.128672 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-386c2e2a-6e34-4a36-ac94-a96855ab9688 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:59.129103 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-386c2e2a-6e34-4a36-ac94-a96855ab9688 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:59.219906 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-386c2e2a-6e34-4a36-ac94-a96855ab9688 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lazy-loading 'services' on Instance uuid 43372cd4-ec10-4467-a0e3-c7b1d44dc50e {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:38:59.303510 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-386c2e2a-6e34-4a36-ac94-a96855ab9688 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments/c250adaa-7d6d-4474-8de3-ed18a6d479a2" status: 202 len: 0 microversion: 2.1 time: 0.189944 Aug 24 12:38:59.304460 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 382/758] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 12:38:59 2022] DELETE /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments/c250adaa-7d6d-4474-8de3-ed18a6d479a2 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:39:00.491015 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-98e431aa-a2a3-4644-82b9-7f4c6a6b4e1e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:00.493347 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-98e431aa-a2a3-4644-82b9-7f4c6a6b4e1e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:00.499972 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-98e431aa-a2a3-4644-82b9-7f4c6a6b4e1e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:00.500461 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-98e431aa-a2a3-4644-82b9-7f4c6a6b4e1e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:00.501109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-98e431aa-a2a3-4644-82b9-7f4c6a6b4e1e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:00.501810 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-98e431aa-a2a3-4644-82b9-7f4c6a6b4e1e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:00.502268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-98e431aa-a2a3-4644-82b9-7f4c6a6b4e1e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:00.502697 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-98e431aa-a2a3-4644-82b9-7f4c6a6b4e1e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:00.534175 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-98e431aa-a2a3-4644-82b9-7f4c6a6b4e1e tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047070 Aug 24 12:39:00.534764 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 377/759] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:00 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:39:00.654479 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f9acc493-2f66-4632-9ea4-9a27e97fd649 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:00.656968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f9acc493-2f66-4632-9ea4-9a27e97fd649 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:00.663537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f9acc493-2f66-4632-9ea4-9a27e97fd649 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:00.664060 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f9acc493-2f66-4632-9ea4-9a27e97fd649 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:00.664498 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f9acc493-2f66-4632-9ea4-9a27e97fd649 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:00.665194 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f9acc493-2f66-4632-9ea4-9a27e97fd649 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:00.665650 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f9acc493-2f66-4632-9ea4-9a27e97fd649 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:00.666074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f9acc493-2f66-4632-9ea4-9a27e97fd649 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:00.697406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f9acc493-2f66-4632-9ea4-9a27e97fd649 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047810 Aug 24 12:39:00.697968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 383/760] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:00 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:39:00.764866 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-04340292-6ce3-4b6d-9a1e-9590c2a354bb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:00.765372 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-04340292-6ce3-4b6d-9a1e-9590c2a354bb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:00.771608 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-04340292-6ce3-4b6d-9a1e-9590c2a354bb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:00.772127 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-04340292-6ce3-4b6d-9a1e-9590c2a354bb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:00.772757 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-04340292-6ce3-4b6d-9a1e-9590c2a354bb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:00.773459 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-04340292-6ce3-4b6d-9a1e-9590c2a354bb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:00.773922 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-04340292-6ce3-4b6d-9a1e-9590c2a354bb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:00.774353 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-04340292-6ce3-4b6d-9a1e-9590c2a354bb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:00.801971 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-04340292-6ce3-4b6d-9a1e-9590c2a354bb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Going to try to terminate instance {{(pid=127307) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:39:00.894122 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-04340292-6ce3-4b6d-9a1e-9590c2a354bb tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 204 len: 0 microversion: 2.1 time: 0.133536 Aug 24 12:39:00.895002 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 378/761] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:39:00 2022] DELETE /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:39:00.902937 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-950f79fd-db83-4e38-9170-9d3105f0594d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:00.903541 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-950f79fd-db83-4e38-9170-9d3105f0594d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:00.910780 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-950f79fd-db83-4e38-9170-9d3105f0594d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:00.911274 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-950f79fd-db83-4e38-9170-9d3105f0594d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:00.911746 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-950f79fd-db83-4e38-9170-9d3105f0594d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:00.912440 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-950f79fd-db83-4e38-9170-9d3105f0594d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:00.912982 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-950f79fd-db83-4e38-9170-9d3105f0594d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:00.913313 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-950f79fd-db83-4e38-9170-9d3105f0594d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:01.053820 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-950f79fd-db83-4e38-9170-9d3105f0594d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:01.061458 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-950f79fd-db83-4e38-9170-9d3105f0594d tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1674 microversion: 2.1 time: 0.162393 Aug 24 12:39:01.062026 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 384/762] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:00 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:01.256083 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-81b1b5bc-1e6f-4947-a044-1949da8a4eee tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Action: 'create', calling method: .version_select at 0x7f46977211f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-192702034"}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:01.543149 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-81b1b5bc-1e6f-4947-a044-1949da8a4eee tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.398695 Aug 24 12:39:01.551781 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 379/763] 10.222.0.58 () {60 vars in 1155 bytes} [Wed Aug 24 12:39:01 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 408 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 12:39:01.556624 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-eabbe095-1a73-4d7d-a53f-ec9283504436 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f4696c7f5e0>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:01.608212 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-eabbe095-1a73-4d7d-a53f-ec9283504436 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b" status: 200 len: 344 microversion: 2.1 time: 0.055065 Aug 24 12:39:01.608780 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 385/764] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 12:39:01 2022] GET /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:02.082804 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b0737046-eb74-40ba-b203-915bf482341f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:02.083533 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-b0737046-eb74-40ba-b203-915bf482341f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:02.090366 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b0737046-eb74-40ba-b203-915bf482341f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:02.090855 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b0737046-eb74-40ba-b203-915bf482341f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:02.091939 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b0737046-eb74-40ba-b203-915bf482341f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:02.092635 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b0737046-eb74-40ba-b203-915bf482341f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:02.093091 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b0737046-eb74-40ba-b203-915bf482341f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:02.093517 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b0737046-eb74-40ba-b203-915bf482341f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:02.225898 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b0737046-eb74-40ba-b203-915bf482341f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:02.233629 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b0737046-eb74-40ba-b203-915bf482341f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1674 microversion: 2.1 time: 0.154757 Aug 24 12:39:02.234229 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 380/765] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:02 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:02.623204 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-3e4b8d67-dcd3-4b9e-a0fd-3eb45fd9c5e6 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f4696ae9670>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:02.668102 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-3e4b8d67-dcd3-4b9e-a0fd-3eb45fd9c5e6 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b" status: 200 len: 345 microversion: 2.1 time: 0.049930 Aug 24 12:39:02.668657 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 386/766] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 12:39:02 2022] GET /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:02.680799 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b11c74eb-13ed-46ab-af4a-1a6a08a2e2f1 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Action: 'create', calling method: .version_select at 0x7f4697359c10>, body: {"snapshot": {"volume_id": "3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-143520909"}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:02.833886 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b11c74eb-13ed-46ab-af4a-1a6a08a2e2f1 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.156775 Aug 24 12:39:02.834601 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 381/767] 10.222.0.58 () {60 vars in 1162 bytes} [Wed Aug 24 12:39:02 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:02.845955 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d0377b10-a4c6-4499-bce2-988a85d47030 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f4696ac2700>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:02.878056 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d0377b10-a4c6-4499-bce2-988a85d47030 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4" status: 200 len: 286 microversion: 2.1 time: 0.036405 Aug 24 12:39:02.878868 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 387/768] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 12:39:02 2022] GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:02.889940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-48022ac9-a1e7-4e80-b842-ac27e2fcf4c1 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f469fd3e430>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:02.921769 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-48022ac9-a1e7-4e80-b842-ac27e2fcf4c1 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035893 Aug 24 12:39:02.922326 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 382/769] 10.222.0.58 () {58 vars in 1140 bytes} [Wed Aug 24 12:39:02 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:02.933026 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-85f16fe0-c6e1-43bd-9b02-f6a282d6caf0 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f4696ae9280>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:02.962941 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-85f16fe0-c6e1-43bd-9b02-f6a282d6caf0 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4" status: 200 len: 286 microversion: 2.1 time: 0.033479 Aug 24 12:39:02.963484 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 388/770] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 12:39:02 2022] GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:03.254648 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8dae1afd-cbf8-4d7a-b37b-17975b2cee09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:03.255266 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8dae1afd-cbf8-4d7a-b37b-17975b2cee09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:03.261362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8dae1afd-cbf8-4d7a-b37b-17975b2cee09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:03.261883 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8dae1afd-cbf8-4d7a-b37b-17975b2cee09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:03.262323 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8dae1afd-cbf8-4d7a-b37b-17975b2cee09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:03.263021 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8dae1afd-cbf8-4d7a-b37b-17975b2cee09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:03.263512 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8dae1afd-cbf8-4d7a-b37b-17975b2cee09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:03.263968 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8dae1afd-cbf8-4d7a-b37b-17975b2cee09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:03.390335 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8dae1afd-cbf8-4d7a-b37b-17975b2cee09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:03.397957 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8dae1afd-cbf8-4d7a-b37b-17975b2cee09 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1674 microversion: 2.1 time: 0.147094 Aug 24 12:39:03.398517 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 383/771] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:03 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:03.976076 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-61a3f399-5003-4b08-8ecc-8ae416fab31d tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f4696a870d0>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:04.004969 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-61a3f399-5003-4b08-8ecc-8ae416fab31d tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4" status: 200 len: 286 microversion: 2.1 time: 0.033129 Aug 24 12:39:04.005533 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 389/772] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 12:39:03 2022] GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:04.419994 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a4ba3791-e326-4a8f-97a8-d051f41bc058 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:04.420707 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a4ba3791-e326-4a8f-97a8-d051f41bc058 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:04.427078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4ba3791-e326-4a8f-97a8-d051f41bc058 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:04.427568 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4ba3791-e326-4a8f-97a8-d051f41bc058 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:04.428032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4ba3791-e326-4a8f-97a8-d051f41bc058 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:04.428725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4ba3791-e326-4a8f-97a8-d051f41bc058 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:04.429190 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4ba3791-e326-4a8f-97a8-d051f41bc058 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:04.429617 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a4ba3791-e326-4a8f-97a8-d051f41bc058 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:04.562377 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a4ba3791-e326-4a8f-97a8-d051f41bc058 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:04.571288 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a4ba3791-e326-4a8f-97a8-d051f41bc058 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1674 microversion: 2.1 time: 0.155578 Aug 24 12:39:04.571854 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 384/773] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:04 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:05.018627 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-cc94dbab-72e0-466f-a0e3-46e80da6472f tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f4696ae58b0>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:05.048429 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-cc94dbab-72e0-466f-a0e3-46e80da6472f tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4" status: 200 len: 286 microversion: 2.1 time: 0.034031 Aug 24 12:39:05.049007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 390/774] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 12:39:05 2022] GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:05.594327 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-930366c8-900b-4243-9f35-032848b3829a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:05.594941 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-930366c8-900b-4243-9f35-032848b3829a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:05.601624 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-930366c8-900b-4243-9f35-032848b3829a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:05.602108 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-930366c8-900b-4243-9f35-032848b3829a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:05.602542 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-930366c8-900b-4243-9f35-032848b3829a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:05.603292 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-930366c8-900b-4243-9f35-032848b3829a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:05.603777 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-930366c8-900b-4243-9f35-032848b3829a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:05.604203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-930366c8-900b-4243-9f35-032848b3829a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:05.730155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-930366c8-900b-4243-9f35-032848b3829a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:05.738293 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-930366c8-900b-4243-9f35-032848b3829a tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1674 microversion: 2.1 time: 0.147811 Aug 24 12:39:05.738870 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 385/775] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:05 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:06.061962 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-152ea308-550e-4b87-a95f-764428f08fa5 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f4696b18310>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:06.096197 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-152ea308-550e-4b87-a95f-764428f08fa5 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4" status: 200 len: 286 microversion: 2.1 time: 0.038991 Aug 24 12:39:06.096844 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 391/776] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 12:39:06 2022] GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:06.337715 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-1cfd162e-b54b-4b11-8388-d2596352887d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:06.340233 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-1cfd162e-b54b-4b11-8388-d2596352887d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:06.347276 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1cfd162e-b54b-4b11-8388-d2596352887d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.348043 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1cfd162e-b54b-4b11-8388-d2596352887d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.348725 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1cfd162e-b54b-4b11-8388-d2596352887d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.349767 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1cfd162e-b54b-4b11-8388-d2596352887d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.351815 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1cfd162e-b54b-4b11-8388-d2596352887d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.351815 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1cfd162e-b54b-4b11-8388-d2596352887d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.392728 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-1cfd162e-b54b-4b11-8388-d2596352887d tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.058960 Aug 24 12:39:06.399188 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 386/777] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:06 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:06.461658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7392864c-48fc-4e9e-adef-5a07b61067b7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:06.462257 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-7392864c-48fc-4e9e-adef-5a07b61067b7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:06.470553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7392864c-48fc-4e9e-adef-5a07b61067b7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.471413 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7392864c-48fc-4e9e-adef-5a07b61067b7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.471888 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7392864c-48fc-4e9e-adef-5a07b61067b7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.472697 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7392864c-48fc-4e9e-adef-5a07b61067b7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.473152 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7392864c-48fc-4e9e-adef-5a07b61067b7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.473568 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7392864c-48fc-4e9e-adef-5a07b61067b7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.501884 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-7392864c-48fc-4e9e-adef-5a07b61067b7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Going to try to terminate instance {{(pid=127308) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:39:06.580718 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-7392864c-48fc-4e9e-adef-5a07b61067b7 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 204 len: 0 microversion: 2.20 time: 0.122901 Aug 24 12:39:06.581360 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 392/778] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 12:39:06 2022] DELETE /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 12:39:06.589892 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-95456cd4-d899-4add-bf32-de07c3e4d14a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:06.590762 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-95456cd4-d899-4add-bf32-de07c3e4d14a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:06.597560 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-95456cd4-d899-4add-bf32-de07c3e4d14a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.598193 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-95456cd4-d899-4add-bf32-de07c3e4d14a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.598608 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-95456cd4-d899-4add-bf32-de07c3e4d14a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.599306 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-95456cd4-d899-4add-bf32-de07c3e4d14a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.599800 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-95456cd4-d899-4add-bf32-de07c3e4d14a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.600396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-95456cd4-d899-4add-bf32-de07c3e4d14a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.605167 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:06.737338 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-19f39c24-0033-497d-8bbd-cddaf0a4df57 req-c3486160-acf5-472b-ade8-af4bd12c9ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43372cd4-ec10-4467-a0e3-c7b1d44dc50e", "name": "network-vif-deleted", "tag": "ba766c95-3ec9-4202-a80a-fc2559e0bdfb"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:06.748203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-19f39c24-0033-497d-8bbd-cddaf0a4df57 req-c3486160-acf5-472b-ade8-af4bd12c9ed6 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.748673 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-19f39c24-0033-497d-8bbd-cddaf0a4df57 req-c3486160-acf5-472b-ade8-af4bd12c9ed6 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.749290 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-19f39c24-0033-497d-8bbd-cddaf0a4df57 req-c3486160-acf5-472b-ade8-af4bd12c9ed6 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.761084 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-95456cd4-d899-4add-bf32-de07c3e4d14a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:06.764823 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-19f39c24-0033-497d-8bbd-cddaf0a4df57 req-c3486160-acf5-472b-ade8-af4bd12c9ed6 service nova] Creating event network-vif-deleted:ba766c95-3ec9-4202-a80a-fc2559e0bdfb for instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e on hv-cinder-84890 Aug 24 12:39:06.770146 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-19f39c24-0033-497d-8bbd-cddaf0a4df57 req-c3486160-acf5-472b-ade8-af4bd12c9ed6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038333 Aug 24 12:39:06.770320 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-95456cd4-d899-4add-bf32-de07c3e4d14a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:06.770738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 393/779] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:06.772031 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-95456cd4-d899-4add-bf32-de07c3e4d14a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:06.774423 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-95456cd4-d899-4add-bf32-de07c3e4d14a tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1718 microversion: 2.20 time: 0.188559 Aug 24 12:39:06.775091 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 387/780] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:06 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1718 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:39:06.775826 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-614d755a-2067-4816-be17-465082ae8d26 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:06.776728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-614d755a-2067-4816-be17-465082ae8d26 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:06.783389 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-614d755a-2067-4816-be17-465082ae8d26 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.783907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-614d755a-2067-4816-be17-465082ae8d26 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.784336 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-614d755a-2067-4816-be17-465082ae8d26 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.786005 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-614d755a-2067-4816-be17-465082ae8d26 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.786455 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-614d755a-2067-4816-be17-465082ae8d26 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.786874 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-614d755a-2067-4816-be17-465082ae8d26 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.853366 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-614d755a-2067-4816-be17-465082ae8d26 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:06.863124 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-614d755a-2067-4816-be17-465082ae8d26 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1607 microversion: 2.1 time: 0.091047 Aug 24 12:39:06.863729 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 394/781] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:06 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1607 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:07.109428 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9dfacff0-2f7e-4d42-8afc-32ab9d64b854 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f469fd42040>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:07.139433 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9dfacff0-2f7e-4d42-8afc-32ab9d64b854 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4" status: 200 len: 287 microversion: 2.1 time: 0.034559 Aug 24 12:39:07.140010 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 388/782] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 12:39:07 2022] GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:07.151009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-edcf0fc1-acc1-4171-9af6-8305b413eba0 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f4696b26ee0>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:07.210093 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-edcf0fc1-acc1-4171-9af6-8305b413eba0 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4" status: 202 len: 0 microversion: 2.1 time: 0.062756 Aug 24 12:39:07.210653 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 395/783] 10.222.0.58 () {58 vars in 1254 bytes} [Wed Aug 24 12:39:07 2022] DELETE /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:39:07.219774 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-bac88f7b-78b6-4cbd-99de-05d1a8b133fa tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f469fd424c0>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:07.250430 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-bac88f7b-78b6-4cbd-99de-05d1a8b133fa tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4" status: 200 len: 286 microversion: 2.1 time: 0.035151 Aug 24 12:39:07.250992 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 389/784] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 12:39:07 2022] GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:07.797771 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2fe34d20-6723-46d9-96a0-78125b1b3d71 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:07.798405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2fe34d20-6723-46d9-96a0-78125b1b3d71 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:07.804533 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2fe34d20-6723-46d9-96a0-78125b1b3d71 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:07.805013 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2fe34d20-6723-46d9-96a0-78125b1b3d71 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:07.805448 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2fe34d20-6723-46d9-96a0-78125b1b3d71 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:07.806131 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2fe34d20-6723-46d9-96a0-78125b1b3d71 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:07.806581 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2fe34d20-6723-46d9-96a0-78125b1b3d71 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:07.806998 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2fe34d20-6723-46d9-96a0-78125b1b3d71 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:07.885784 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c572f2a6-dd94-4526-84af-c362f8f8c89c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:07.886387 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c572f2a6-dd94-4526-84af-c362f8f8c89c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:07.894334 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c572f2a6-dd94-4526-84af-c362f8f8c89c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:07.894970 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c572f2a6-dd94-4526-84af-c362f8f8c89c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:07.895416 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c572f2a6-dd94-4526-84af-c362f8f8c89c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:07.896158 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c572f2a6-dd94-4526-84af-c362f8f8c89c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:07.896676 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c572f2a6-dd94-4526-84af-c362f8f8c89c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:07.897110 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c572f2a6-dd94-4526-84af-c362f8f8c89c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:07.953241 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2fe34d20-6723-46d9-96a0-78125b1b3d71 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:07.961416 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2fe34d20-6723-46d9-96a0-78125b1b3d71 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:07.962962 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2fe34d20-6723-46d9-96a0-78125b1b3d71 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:07.964181 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2fe34d20-6723-46d9-96a0-78125b1b3d71 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1718 microversion: 2.20 time: 0.170425 Aug 24 12:39:07.964745 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 396/785] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:07 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1718 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:07.969395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-c572f2a6-dd94-4526-84af-c362f8f8c89c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0d97f3f08f46af851492aee6a8d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd9970f0694314b966d86f13b83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:07.978880 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c572f2a6-dd94-4526-84af-c362f8f8c89c tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 200 len: 1607 microversion: 2.1 time: 0.097326 Aug 24 12:39:07.979443 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 390/786] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:07 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 1607 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:08.263581 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-97f74448-4f59-4dfb-8bb3-e51866b10451 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f4696ac2b80>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:08.288852 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-97f74448-4f59-4dfb-8bb3-e51866b10451 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] HTTP exception thrown: Snapshot 823afab5-7acd-49c8-a8a8-748d6e21dac4 could not be found. Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-97f74448-4f59-4dfb-8bb3-e51866b10451 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Request method failure captured: Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4 HTTP/1.1 Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhvlNVYQpNk1x1AQ4dbG_cP-0lqr5fiw1haS3uJ1RGg54zw0pxWY1J87PAIH1wrpRf3uctux7rDxPU3avC15lBxIg5Zs1-82WF7THMNFBthpEti3i6E_oySD_sPptRbi5sPbZLUF9iBD3lnIRVzH17C6IawNTMADmcMvCvTvcj4iua8 Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 3e2f7c6ccdf048d8b4db223de2ded668 Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-894250319 Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:39:08.291207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:39:08.293039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:08.293039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-VolumesSnapshotsTestJSON-894250319 Aug 24 12:39:08.293039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 3e2f7c6ccdf048d8b4db223de2ded668 Aug 24 12:39:08.293039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-894250319 Aug 24 12:39:08.293039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-VolumesSnapshotsTestJSON-894250319-project Aug 24 12:39:08.293039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:39:08.293039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:39:08.293039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: b617a6fcd083498f81373bff6673c094 Aug 24 12:39:08.293039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-VolumesSnapshotsTestJSON-894250319-project Aug 24 12:39:08.293039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: Aug 24 12:39:08.293039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Snapshot 823afab5-7acd-49c8-a8a8-748d6e21dac4 could not be found. Aug 24 12:39:08.293039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '823afab5-7acd-49c8-a8a8-748d6e21dac4'} Aug 24 12:39:08.293039 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 823afab5-7acd-49c8-a8a8-748d6e21dac4 could not be found. (HTTP 404) (Request-ID: req-15001acf-0b8b-4a17-aa1b-e656d2a3db5d) Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:08.294799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:39:08.296537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 823afab5-7acd-49c8-a8a8-748d6e21dac4 could not be found. Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 12:39:08.298007 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:08.299466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 823afab5-7acd-49c8-a8a8-748d6e21dac4 could not be found. Aug 24 12:39:08.299466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:08.299466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:08.299466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:08.299466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:08.299466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:08.299466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:08.299466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:08.299466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:08.299466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 823afab5-7acd-49c8-a8a8-748d6e21dac4 could not be found. Aug 24 12:39:08.299466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:08.299466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-97f74448-4f59-4dfb-8bb3-e51866b10451 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Returning 404 to user: Snapshot 823afab5-7acd-49c8-a8a8-748d6e21dac4 could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:08.299466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-97f74448-4f59-4dfb-8bb3-e51866b10451 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4" status: 404 len: 111 microversion: 2.1 time: 0.033304 Aug 24 12:39:08.299466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 397/787] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 12:39:08 2022] GET /compute/v2.1/os-snapshots/823afab5-7acd-49c8-a8a8-748d6e21dac4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:39:08.301928 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-58c8ed7d-fec1-4600-bd78-fb2dc8c05b7a tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f469fd50550>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:08.364086 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-58c8ed7d-fec1-4600-bd78-fb2dc8c05b7a tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b" status: 202 len: 0 microversion: 2.1 time: 0.065758 Aug 24 12:39:08.364652 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 391/788] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 12:39:08 2022] DELETE /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:39:08.373579 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1e0b7def-1da2-4c8e-a5f6-67f90e5f1240 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f4696ac38b0>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:08.426604 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1e0b7def-1da2-4c8e-a5f6-67f90e5f1240 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b" status: 200 len: 344 microversion: 2.1 time: 0.057618 Aug 24 12:39:08.427169 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 398/789] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 12:39:08 2022] GET /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:08.532703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-4bebfbfd-916e-4b09-892a-ef3ce3dd83d4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7eaa07d-a363-4937-a9a0-ff1eee6f0ad1", "device": "/dev/sdb"}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:08.536138 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-4bebfbfd-916e-4b09-892a-ef3ce3dd83d4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:08.538042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:08.547738 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4bebfbfd-916e-4b09-892a-ef3ce3dd83d4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:08.549023 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4bebfbfd-916e-4b09-892a-ef3ce3dd83d4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:08.549508 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4bebfbfd-916e-4b09-892a-ef3ce3dd83d4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:08.550269 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4bebfbfd-916e-4b09-892a-ef3ce3dd83d4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:08.551063 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4bebfbfd-916e-4b09-892a-ef3ce3dd83d4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:08.551580 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4bebfbfd-916e-4b09-892a-ef3ce3dd83d4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:08.802306 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-4bebfbfd-916e-4b09-892a-ef3ce3dd83d4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "POST /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274126 Aug 24 12:39:08.802947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 392/790] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 12:39:08 2022] POST /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:08.987038 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e47d16a9-9420-4027-8b60-4315e5e1c536 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:08.987670 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e47d16a9-9420-4027-8b60-4315e5e1c536 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:08.993737 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e47d16a9-9420-4027-8b60-4315e5e1c536 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:08.994225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e47d16a9-9420-4027-8b60-4315e5e1c536 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:08.994659 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e47d16a9-9420-4027-8b60-4315e5e1c536 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:08.995436 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e47d16a9-9420-4027-8b60-4315e5e1c536 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:08.996082 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e47d16a9-9420-4027-8b60-4315e5e1c536 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:08.996661 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e47d16a9-9420-4027-8b60-4315e5e1c536 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:09.002023 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e15badb4-b4b5-466a-9f68-000cffe1d05f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:09.002893 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e15badb4-b4b5-466a-9f68-000cffe1d05f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:09.011148 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e15badb4-b4b5-466a-9f68-000cffe1d05f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:09.013976 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e15badb4-b4b5-466a-9f68-000cffe1d05f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:09.014662 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e15badb4-b4b5-466a-9f68-000cffe1d05f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:09.016529 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e15badb4-b4b5-466a-9f68-000cffe1d05f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:09.017087 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e15badb4-b4b5-466a-9f68-000cffe1d05f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:09.018834 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e15badb4-b4b5-466a-9f68-000cffe1d05f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:09.035997 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-e15badb4-b4b5-466a-9f68-000cffe1d05f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] HTTP exception thrown: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e15badb4-b4b5-466a-9f68-000cffe1d05f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Request method failure captured: Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e HTTP/1.1 Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhplsuIjfxBizWlk2GTc6OwB0NAv2--8K3n4Uq18iQ-WuP2-sfoghLCm_b2-dA07neiLMaZMzQYZdfmVINt5LQ2wKvb3DIBqrP0lK0t1H7ep_nerjij3idaG05KL5Q04kJlFo2zNaAz6HZxQ91eaaEscvzdytHSBtlBJ9iOeHAvf3rw Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: 36bd9970f0694314b966d86f13b83d4b Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:39:09.037740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:39:09.039364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:09.039364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:39:09.039364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: 36bd9970f0694314b966d86f13b83d4b Aug 24 12:39:09.039364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:39:09.039364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeTestJSON-881897809-project Aug 24 12:39:09.039364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:39:09.039364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:39:09.039364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: ed0d97f3f08f46af851492aee6a8d0ef Aug 24 12:39:09.039364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeTestJSON-881897809-project Aug 24 12:39:09.039364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:39:09.039364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. Aug 24 12:39:09.039364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': '43372cd4-ec10-4467-a0e3-c7b1d44dc50e'} Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:09.040315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. Aug 24 12:39:09.041825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.043309 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e15badb4-b4b5-466a-9f68-000cffe1d05f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Returning 404 to user: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:09.043309 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e15badb4-b4b5-466a-9f68-000cffe1d05f tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 404 len: 111 microversion: 2.1 time: 0.043868 Aug 24 12:39:09.043309 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 393/791] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:08 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 12:39:09.054085 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-43bfdc10-4552-467f-bc32-7bfb74fedbb9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '.version_select at 0x7f4697721280>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:09.076623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e47d16a9-9420-4027-8b60-4315e5e1c536 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:09.077156 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-43bfdc10-4552-467f-bc32-7bfb74fedbb9 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218538827" status: 202 len: 0 microversion: 2.1 time: 0.027652 Aug 24 12:39:09.077843 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 394/792] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 24 12:39:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218538827 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:39:09.088821 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e47d16a9-9420-4027-8b60-4315e5e1c536 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:09.090312 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e47d16a9-9420-4027-8b60-4315e5e1c536 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28dac3ee2d5c4ff5ba2d15b59e57d2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38fa406b760405f8d3004db272f1e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:09.091875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e47d16a9-9420-4027-8b60-4315e5e1c536 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 200 len: 1653 microversion: 2.20 time: 0.108532 Aug 24 12:39:09.092729 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 399/793] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:08 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 1653 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:09.414093 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-8e29d866-7e02-4bd8-8886-ab241e159f27 req-b2143756-f029-434e-9286-a8dbd989f826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec78743-6cd7-4df3-a22c-72acff29cf1a", "name": "network-vif-deleted", "tag": "50ca3644-951e-4983-8b1f-534cdf89c8cb"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:09.425668 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-8e29d866-7e02-4bd8-8886-ab241e159f27 req-b2143756-f029-434e-9286-a8dbd989f826 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:09.426450 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-8e29d866-7e02-4bd8-8886-ab241e159f27 req-b2143756-f029-434e-9286-a8dbd989f826 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:09.439125 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-8e29d866-7e02-4bd8-8886-ab241e159f27 req-b2143756-f029-434e-9286-a8dbd989f826 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:09.441604 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c3eeee53-5a11-4d5f-89fa-0391233de3b3 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f4696ac2550>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:09.464733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-8e29d866-7e02-4bd8-8886-ab241e159f27 req-b2143756-f029-434e-9286-a8dbd989f826 service nova] Creating event network-vif-deleted:50ca3644-951e-4983-8b1f-534cdf89c8cb for instance cec78743-6cd7-4df3-a22c-72acff29cf1a on hv-cinder-84890 Aug 24 12:39:09.477274 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-8e29d866-7e02-4bd8-8886-ab241e159f27 req-b2143756-f029-434e-9286-a8dbd989f826 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066575 Aug 24 12:39:09.480491 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 395/794] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:09.497612 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-c3eeee53-5a11-4d5f-89fa-0391233de3b3 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] HTTP exception thrown: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c3eeee53-5a11-4d5f-89fa-0391233de3b3 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Request method failure captured: Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b HTTP/1.1 Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhvlNVYQpNk1x1AQ4dbG_cP-0lqr5fiw1haS3uJ1RGg54zw0pxWY1J87PAIH1wrpRf3uctux7rDxPU3avC15lBxIg5Zs1-82WF7THMNFBthpEti3i6E_oySD_sPptRbi5sPbZLUF9iBD3lnIRVzH17C6IawNTMADmcMvCvTvcj4iua8 Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 3e2f7c6ccdf048d8b4db223de2ded668 Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-894250319 Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:39:09.500309 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:39:09.501778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:09.501778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-VolumesSnapshotsTestJSON-894250319 Aug 24 12:39:09.501778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 3e2f7c6ccdf048d8b4db223de2ded668 Aug 24 12:39:09.501778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-894250319 Aug 24 12:39:09.501778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-VolumesSnapshotsTestJSON-894250319-project Aug 24 12:39:09.501778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:39:09.501778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:39:09.501778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: b617a6fcd083498f81373bff6673c094 Aug 24 12:39:09.501778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-VolumesSnapshotsTestJSON-894250319-project Aug 24 12:39:09.501778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: Aug 24 12:39:09.501778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. Aug 24 12:39:09.501778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b'} Aug 24 12:39:09.501778 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. (HTTP 404) (Request-ID: req-e09a8e17-2361-4b02-9a9d-a4c7a638a86d) Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:09.502732 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:39:09.504516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 12:39:09.505682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:09.506855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. Aug 24 12:39:09.506855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.506855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:09.506855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.506855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:09.506855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:09.506855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:09.506855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:09.506855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:09.506855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. Aug 24 12:39:09.506855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.506855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c3eeee53-5a11-4d5f-89fa-0391233de3b3 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Returning 404 to user: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:09.506855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c3eeee53-5a11-4d5f-89fa-0391233de3b3 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b" status: 404 len: 109 microversion: 2.1 time: 0.064514 Aug 24 12:39:09.506855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 400/795] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 12:39:09 2022] GET /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 12:39:09.514525 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-bdd57595-5213-47cb-9160-18bb1498b8cb tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f469fd3e310>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:09.556066 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-bdd57595-5213-47cb-9160-18bb1498b8cb tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] HTTP exception thrown: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-bdd57595-5213-47cb-9160-18bb1498b8cb tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Request method failure captured: Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: DELETE /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b HTTP/1.1 Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhvlNVYQpNk1x1AQ4dbG_cP-0lqr5fiw1haS3uJ1RGg54zw0pxWY1J87PAIH1wrpRf3uctux7rDxPU3avC15lBxIg5Zs1-82WF7THMNFBthpEti3i6E_oySD_sPptRbi5sPbZLUF9iBD3lnIRVzH17C6IawNTMADmcMvCvTvcj4iua8 Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: 3e2f7c6ccdf048d8b4db223de2ded668 Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-894250319 Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:39:09.560297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:39:09.562203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:09.562203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-VolumesSnapshotsTestJSON-894250319 Aug 24 12:39:09.562203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: 3e2f7c6ccdf048d8b4db223de2ded668 Aug 24 12:39:09.562203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-894250319 Aug 24 12:39:09.562203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-VolumesSnapshotsTestJSON-894250319-project Aug 24 12:39:09.562203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:39:09.562203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:39:09.562203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: b617a6fcd083498f81373bff6673c094 Aug 24 12:39:09.562203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-VolumesSnapshotsTestJSON-894250319-project Aug 24 12:39:09.562203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: Aug 24 12:39:09.562203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. Aug 24 12:39:09.562203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': '3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b'} Aug 24 12:39:09.562203 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. (HTTP 404) (Request-ID: req-ad1832a0-eec7-48fa-af7f-8f2468cfd5bf) Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:09.563397 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:39:09.564703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 12:39:09.567282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:09.569733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. Aug 24 12:39:09.569733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.569733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:09.569733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.569733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:09.569733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:09.569733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:09.569733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:09.569733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:09.569733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. Aug 24 12:39:09.569733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.569733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-bdd57595-5213-47cb-9160-18bb1498b8cb tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Returning 404 to user: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:09.569733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-bdd57595-5213-47cb-9160-18bb1498b8cb tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b" status: 404 len: 109 microversion: 2.1 time: 0.052419 Aug 24 12:39:09.569733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 396/796] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 12:39:09 2022] DELETE /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:39:09.571835 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e2e731e3-2131-4e6f-ba2d-d39b4fdc6ab8 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Calling method '.version_select at 0x7f4696ae9550>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:09.605710 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-e2e731e3-2131-4e6f-ba2d-d39b4fdc6ab8 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] HTTP exception thrown: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e2e731e3-2131-4e6f-ba2d-d39b4fdc6ab8 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Request method failure captured: Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b HTTP/1.1 Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhvlNVYQpNk1x1AQ4dbG_cP-0lqr5fiw1haS3uJ1RGg54zw0pxWY1J87PAIH1wrpRf3uctux7rDxPU3avC15lBxIg5Zs1-82WF7THMNFBthpEti3i6E_oySD_sPptRbi5sPbZLUF9iBD3lnIRVzH17C6IawNTMADmcMvCvTvcj4iua8 Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 3e2f7c6ccdf048d8b4db223de2ded668 Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-894250319 Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:39:09.608472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:39:09.609890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e2f7c6ccdf048d8b4db223de2ded668"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:09.609890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-VolumesSnapshotsTestJSON-894250319 Aug 24 12:39:09.609890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 3e2f7c6ccdf048d8b4db223de2ded668 Aug 24 12:39:09.609890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-894250319 Aug 24 12:39:09.609890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-VolumesSnapshotsTestJSON-894250319-project Aug 24 12:39:09.609890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:39:09.609890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:39:09.609890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: b617a6fcd083498f81373bff6673c094 Aug 24 12:39:09.609890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-VolumesSnapshotsTestJSON-894250319-project Aug 24 12:39:09.609890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: Aug 24 12:39:09.609890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. Aug 24 12:39:09.609890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b'} Aug 24 12:39:09.609890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. (HTTP 404) (Request-ID: req-aca33e47-a4bd-4c21-860e-841cc210e566) Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:09.610740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:39:09.611940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 12:39:09.613914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:09.615294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. Aug 24 12:39:09.615294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.615294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:09.615294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.615294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:09.615294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:09.615294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:09.615294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:09.615294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:09.615294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. Aug 24 12:39:09.615294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:09.615294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e2e731e3-2131-4e6f-ba2d-d39b4fdc6ab8 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] Returning 404 to user: Volume 3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:09.615294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e2e731e3-2131-4e6f-ba2d-d39b4fdc6ab8 tempest-VolumesSnapshotsTestJSON-894250319 tempest-VolumesSnapshotsTestJSON-894250319-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b" status: 404 len: 109 microversion: 2.1 time: 0.043866 Aug 24 12:39:09.619717 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 401/797] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 12:39:09 2022] GET /compute/v2.1/os-volumes/3a3cf89a-7b06-4902-a5e0-bd0cadf1f64b => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:39:10.118127 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c9dae220-0a1e-4fab-97fe-ba9cdcec5612 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:10.120961 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-c9dae220-0a1e-4fab-97fe-ba9cdcec5612 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:10.130501 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c9dae220-0a1e-4fab-97fe-ba9cdcec5612 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:10.131334 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c9dae220-0a1e-4fab-97fe-ba9cdcec5612 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:10.133449 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c9dae220-0a1e-4fab-97fe-ba9cdcec5612 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:10.134942 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c9dae220-0a1e-4fab-97fe-ba9cdcec5612 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:10.135866 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c9dae220-0a1e-4fab-97fe-ba9cdcec5612 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:10.136495 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-c9dae220-0a1e-4fab-97fe-ba9cdcec5612 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:10.160618 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-c9dae220-0a1e-4fab-97fe-ba9cdcec5612 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] HTTP exception thrown: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c9dae220-0a1e-4fab-97fe-ba9cdcec5612 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Request method failure captured: Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a HTTP/1.1 Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhplx9vIDtCGdDFFAVdrWbsbK7UFSa6YKTkdck275IH7y_8SPhXCYXZ1NCr2N8jds7FLyCnLM1I4cEXDwB-UUmQ5i0bQKYBGNDrvU9KIhgk4mW1oIvZT9U35gxW10HYEHXM0nyaJNOGGp4Wcdhh3g8tOxt83BZ0YkjKmZ0ecRcqlVlY Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: b38fa406b760405f8d3004db272f1e52 Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:39:10.162374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:39:10.164940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b38fa406b760405f8d3004db272f1e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:10.164940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:39:10.164940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: b38fa406b760405f8d3004db272f1e52 Aug 24 12:39:10.164940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:39:10.164940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeShelveTestJSON-615962332-project Aug 24 12:39:10.164940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:39:10.164940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:39:10.164940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 28dac3ee2d5c4ff5ba2d15b59e57d2a7 Aug 24 12:39:10.164940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-615962332-project Aug 24 12:39:10.164940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:39:10.164940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. Aug 24 12:39:10.164940 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': 'cec78743-6cd7-4df3-a22c-72acff29cf1a'} Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:10.165993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. Aug 24 12:39:10.167469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:10.170667 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-c9dae220-0a1e-4fab-97fe-ba9cdcec5612 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Returning 404 to user: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:10.170667 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-c9dae220-0a1e-4fab-97fe-ba9cdcec5612 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 404 len: 111 microversion: 2.20 time: 0.051891 Aug 24 12:39:10.170667 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 397/798] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:10 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:39:10.174229 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7eb8362f-6984-4b76-9333-72aae464da6e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '.version_select at 0x7f4696b5d160>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:10.193693 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-7eb8362f-6984-4b76-9333-72aae464da6e tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-801442472" status: 204 len: 0 microversion: 2.20 time: 0.024635 Aug 24 12:39:10.194269 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 402/799] 10.222.0.58 () {60 vars in 1259 bytes} [Wed Aug 24 12:39:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-801442472 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 12:39:11.378424 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-fc24d54a-ee26-41e2-9a38-af4c8734e3c1 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Action: 'create', calling method: .version_select at 0x7f469fd21a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-988413515", "metadata": {"Type": "work"}}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-fc24d54a-ee26-41e2-9a38-af4c8734e3c1 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Request method failure captured: Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 121 Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhvvCvB0cxEiiOM9B5Iw0vuGcqmF4Q4Guz6arIEBaGi7krJvz6-OHrE9Mw3p45GkqiJbId3Xo2oFbAHzBnbeS4uvaimTsokPMUO8f5tmDNwrQbAFadKPKsDZYrJc1ux_KMU0Rk3knfDtG-g_9aQms4cRipTrYc5Nouom5b3dFi2L-vs Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: 179f6e9bbf1d4f6bb7f57f88d5941ac7 Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:39:11.390582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:39:11.392105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:11.392105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.392105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: 179f6e9bbf1d4f6bb7f57f88d5941ac7 Aug 24 12:39:11.392105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.392105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-VolumesNegativeTest-616838590-project Aug 24 12:39:11.392105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:39:11.392105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:39:11.392105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 69a436b39b324fcc81b72b6ce7d7190c Aug 24 12:39:11.392105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-VolumesNegativeTest-616838590-project Aug 24 12:39:11.392105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Aug 24 12:39:11.392105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-988413515", "metadata": {"Type": "work"}}} Aug 24 12:39:11.392105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: Aug 24 12:39:11.392105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-988413515', 'metadata': {'Type': 'work'}}}} Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise error Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:11.393199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 12:39:11.394945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 12:39:11.396184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 12:39:11.396184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.396184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-fc24d54a-ee26-41e2-9a38-af4c8734e3c1 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:11.396184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-fc24d54a-ee26-41e2-9a38-af4c8734e3c1 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.153572 Aug 24 12:39:11.396184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 398/800] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 24 12:39:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:39:11.402801 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-39797819-bc98-4a27-a228-34773abe4aab tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Action: 'create', calling method: .version_select at 0x7f4696a8e1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1319680825", "metadata": {"Type": "work"}}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-39797819-bc98-4a27-a228-34773abe4aab tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Request method failure captured: Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 120 Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhvvCvB0cxEiiOM9B5Iw0vuGcqmF4Q4Guz6arIEBaGi7krJvz6-OHrE9Mw3p45GkqiJbId3Xo2oFbAHzBnbeS4uvaimTsokPMUO8f5tmDNwrQbAFadKPKsDZYrJc1ux_KMU0Rk3knfDtG-g_9aQms4cRipTrYc5Nouom5b3dFi2L-vs Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 179f6e9bbf1d4f6bb7f57f88d5941ac7 Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:39:11.408907 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:39:11.410587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:11.410587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.410587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 179f6e9bbf1d4f6bb7f57f88d5941ac7 Aug 24 12:39:11.410587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.410587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-VolumesNegativeTest-616838590-project Aug 24 12:39:11.410587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:39:11.410587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:39:11.410587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 69a436b39b324fcc81b72b6ce7d7190c Aug 24 12:39:11.410587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-VolumesNegativeTest-616838590-project Aug 24 12:39:11.410587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Aug 24 12:39:11.410587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1319680825", "metadata": {"Type": "work"}}} Aug 24 12:39:11.410587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: Aug 24 12:39:11.410587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1319680825', 'metadata': {'Type': 'work'}}}} Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise error Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi '0' Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:11.411810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 12:39:11.417551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 12:39:11.419589 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 12:39:11.419589 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.419589 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-39797819-bc98-4a27-a228-34773abe4aab tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:11.419589 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-39797819-bc98-4a27-a228-34773abe4aab tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012224 Aug 24 12:39:11.419589 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 403/801] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 24 12:39:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:39:11.424757 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5a966ae3-d4df-4cbb-855d-673b2fa83aa4 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Action: 'create', calling method: .version_select at 0x7f469fcf7430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1701150148", "metadata": {"Type": "work"}}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5a966ae3-d4df-4cbb-855d-673b2fa83aa4 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Request method failure captured: Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 119 Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhvvCvB0cxEiiOM9B5Iw0vuGcqmF4Q4Guz6arIEBaGi7krJvz6-OHrE9Mw3p45GkqiJbId3Xo2oFbAHzBnbeS4uvaimTsokPMUO8f5tmDNwrQbAFadKPKsDZYrJc1ux_KMU0Rk3knfDtG-g_9aQms4cRipTrYc5Nouom5b3dFi2L-vs Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: 179f6e9bbf1d4f6bb7f57f88d5941ac7 Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:39:11.429268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:39:11.430888 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:11.430888 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.430888 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: 179f6e9bbf1d4f6bb7f57f88d5941ac7 Aug 24 12:39:11.430888 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.430888 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-VolumesNegativeTest-616838590-project Aug 24 12:39:11.430888 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:39:11.430888 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:39:11.430888 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 69a436b39b324fcc81b72b6ce7d7190c Aug 24 12:39:11.430888 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-VolumesNegativeTest-616838590-project Aug 24 12:39:11.430888 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Aug 24 12:39:11.430888 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1701150148", "metadata": {"Type": "work"}}} Aug 24 12:39:11.430888 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: Aug 24 12:39:11.430888 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1701150148', 'metadata': {'Type': 'work'}}}} Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise error Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi '' Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:11.431995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 12:39:11.433735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 12:39:11.435456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 12:39:11.435456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.435456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5a966ae3-d4df-4cbb-855d-673b2fa83aa4 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:11.435456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5a966ae3-d4df-4cbb-855d-673b2fa83aa4 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010015 Aug 24 12:39:11.435456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 399/802] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 24 12:39:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:39:11.440536 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a79b2bbf-abb6-419b-8634-95ef119300a0 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Calling method '.version_select at 0x7f4696b185e0>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:11.470790 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-a79b2bbf-abb6-419b-8634-95ef119300a0 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] HTTP exception thrown: Volume tempest-invalid-464260283 could not be found. Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a79b2bbf-abb6-419b-8634-95ef119300a0 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Request method failure captured: Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-464260283 HTTP/1.1 Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhvvCvB0cxEiiOM9B5Iw0vuGcqmF4Q4Guz6arIEBaGi7krJvz6-OHrE9Mw3p45GkqiJbId3Xo2oFbAHzBnbeS4uvaimTsokPMUO8f5tmDNwrQbAFadKPKsDZYrJc1ux_KMU0Rk3knfDtG-g_9aQms4cRipTrYc5Nouom5b3dFi2L-vs Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 179f6e9bbf1d4f6bb7f57f88d5941ac7 Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:39:11.472819 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:39:11.474489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:11.474489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.474489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 179f6e9bbf1d4f6bb7f57f88d5941ac7 Aug 24 12:39:11.474489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.474489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-VolumesNegativeTest-616838590-project Aug 24 12:39:11.474489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:39:11.474489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:39:11.474489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 69a436b39b324fcc81b72b6ce7d7190c Aug 24 12:39:11.474489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-VolumesNegativeTest-616838590-project Aug 24 12:39:11.474489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: Aug 24 12:39:11.474489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Volume tempest-invalid-464260283 could not be found. Aug 24 12:39:11.474489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': 'tempest-invalid-464260283'} Aug 24 12:39:11.474489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-464260283 could not be found. (HTTP 404) (Request-ID: req-5b0b85ef-7887-45b3-a9db-b95f148089a4) Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:11.475324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:39:11.476569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-464260283 could not be found. Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:11.477738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-464260283 could not be found. Aug 24 12:39:11.479137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.479137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:11.479137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.479137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.479137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:11.479137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:11.479137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:11.479137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:11.479137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-464260283 could not be found. Aug 24 12:39:11.479137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.479137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a79b2bbf-abb6-419b-8634-95ef119300a0 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Returning 404 to user: Volume tempest-invalid-464260283 could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:11.479137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a79b2bbf-abb6-419b-8634-95ef119300a0 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-464260283" status: 404 len: 98 microversion: 2.1 time: 0.037514 Aug 24 12:39:11.479137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 404/803] 10.222.0.58 () {58 vars in 1215 bytes} [Wed Aug 24 12:39:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-464260283 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 12:39:11.485217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-4661491f-ffce-4465-9f40-866307c30621 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004898 Aug 24 12:39:11.485913 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 400/804] 10.222.0.58 () {58 vars in 1140 bytes} [Wed Aug 24 12:39:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 12:39:11.494396 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-3f40b48e-cf63-4aa1-8dfd-48a502689bb5 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003773 Aug 24 12:39:11.494877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 405/805] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 12:39:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 12:39:11.504055 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5625c769-a5e3-4bf1-b0dd-de4b32c7239b tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Calling method '.version_select at 0x7f469fd219d0>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:11.536791 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-5625c769-a5e3-4bf1-b0dd-de4b32c7239b tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] HTTP exception thrown: Volume 9fd96a87-0030-492f-8df7-f70d8980c8f0 could not be found. Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5625c769-a5e3-4bf1-b0dd-de4b32c7239b tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Request method failure captured: Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: DELETE /compute/v2.1/os-volumes/9fd96a87-0030-492f-8df7-f70d8980c8f0 HTTP/1.1 Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhvvCvB0cxEiiOM9B5Iw0vuGcqmF4Q4Guz6arIEBaGi7krJvz6-OHrE9Mw3p45GkqiJbId3Xo2oFbAHzBnbeS4uvaimTsokPMUO8f5tmDNwrQbAFadKPKsDZYrJc1ux_KMU0Rk3knfDtG-g_9aQms4cRipTrYc5Nouom5b3dFi2L-vs Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: 179f6e9bbf1d4f6bb7f57f88d5941ac7 Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:39:11.538839 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:39:11.540264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:11.540264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.540264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: 179f6e9bbf1d4f6bb7f57f88d5941ac7 Aug 24 12:39:11.540264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.540264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-VolumesNegativeTest-616838590-project Aug 24 12:39:11.540264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:39:11.540264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:39:11.540264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 69a436b39b324fcc81b72b6ce7d7190c Aug 24 12:39:11.540264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-VolumesNegativeTest-616838590-project Aug 24 12:39:11.540264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: Aug 24 12:39:11.540264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Volume 9fd96a87-0030-492f-8df7-f70d8980c8f0 could not be found. Aug 24 12:39:11.540264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': '9fd96a87-0030-492f-8df7-f70d8980c8f0'} Aug 24 12:39:11.540264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9fd96a87-0030-492f-8df7-f70d8980c8f0 could not be found. (HTTP 404) (Request-ID: req-b83402b4-e50f-4f47-b38c-781a71ac38ed) Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:11.541077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:39:11.542349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9fd96a87-0030-492f-8df7-f70d8980c8f0 could not be found. Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 12:39:11.543606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:11.547780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9fd96a87-0030-492f-8df7-f70d8980c8f0 could not be found. Aug 24 12:39:11.547780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.547780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:11.547780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.547780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.547780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:11.547780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:11.547780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:11.547780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:11.547780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9fd96a87-0030-492f-8df7-f70d8980c8f0 could not be found. Aug 24 12:39:11.547780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.547780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5625c769-a5e3-4bf1-b0dd-de4b32c7239b tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Returning 404 to user: Volume 9fd96a87-0030-492f-8df7-f70d8980c8f0 could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:11.547780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5625c769-a5e3-4bf1-b0dd-de4b32c7239b tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/9fd96a87-0030-492f-8df7-f70d8980c8f0" status: 404 len: 109 microversion: 2.1 time: 0.040596 Aug 24 12:39:11.547780 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 401/806] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 12:39:11 2022] DELETE /compute/v2.1/os-volumes/9fd96a87-0030-492f-8df7-f70d8980c8f0 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:39:11.552027 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-cafee64f-d531-4f0e-a5e5-b318ef5b4b38 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Calling method '.version_select at 0x7f469c050670>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:11.581948 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-cafee64f-d531-4f0e-a5e5-b318ef5b4b38 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] HTTP exception thrown: Volume 118fb011-9671-41d1-a40a-b771982c694a could not be found. Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-cafee64f-d531-4f0e-a5e5-b318ef5b4b38 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Request method failure captured: Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/os-volumes/118fb011-9671-41d1-a40a-b771982c694a HTTP/1.1 Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhvvCvB0cxEiiOM9B5Iw0vuGcqmF4Q4Guz6arIEBaGi7krJvz6-OHrE9Mw3p45GkqiJbId3Xo2oFbAHzBnbeS4uvaimTsokPMUO8f5tmDNwrQbAFadKPKsDZYrJc1ux_KMU0Rk3knfDtG-g_9aQms4cRipTrYc5Nouom5b3dFi2L-vs Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 179f6e9bbf1d4f6bb7f57f88d5941ac7 Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:39:11.583970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:39:11.585725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_179f6e9bbf1d4f6bb7f57f88d5941ac7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:11.585725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.585725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 179f6e9bbf1d4f6bb7f57f88d5941ac7 Aug 24 12:39:11.585725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-VolumesNegativeTest-616838590 Aug 24 12:39:11.585725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-VolumesNegativeTest-616838590-project Aug 24 12:39:11.585725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:39:11.585725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:39:11.585725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 69a436b39b324fcc81b72b6ce7d7190c Aug 24 12:39:11.585725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-VolumesNegativeTest-616838590-project Aug 24 12:39:11.585725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: Aug 24 12:39:11.585725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Volume 118fb011-9671-41d1-a40a-b771982c694a could not be found. Aug 24 12:39:11.585725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '118fb011-9671-41d1-a40a-b771982c694a'} Aug 24 12:39:11.585725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 118fb011-9671-41d1-a40a-b771982c694a could not be found. (HTTP 404) (Request-ID: req-032a337e-7445-4fbe-9943-52c4ea7638ec) Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:11.586662 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:39:11.587957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 118fb011-9671-41d1-a40a-b771982c694a could not be found. Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 12:39:11.589122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:11.590358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 118fb011-9671-41d1-a40a-b771982c694a could not be found. Aug 24 12:39:11.590358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.590358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:11.590358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.590358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:11.590358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:11.590358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:11.590358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:11.590358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:11.590358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 118fb011-9671-41d1-a40a-b771982c694a could not be found. Aug 24 12:39:11.590358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:11.590358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-cafee64f-d531-4f0e-a5e5-b318ef5b4b38 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] Returning 404 to user: Volume 118fb011-9671-41d1-a40a-b771982c694a could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:11.590358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-cafee64f-d531-4f0e-a5e5-b318ef5b4b38 tempest-VolumesNegativeTest-616838590 tempest-VolumesNegativeTest-616838590-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/118fb011-9671-41d1-a40a-b771982c694a" status: 404 len: 109 microversion: 2.1 time: 0.038776 Aug 24 12:39:11.590358 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 406/807] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 12:39:11 2022] GET /compute/v2.1/os-volumes/118fb011-9671-41d1-a40a-b771982c694a => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:39:12.353854 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b2080914-20ed-42c2-9d3a-8e9f5d631ce1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:12.354360 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-b2080914-20ed-42c2-9d3a-8e9f5d631ce1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:12.360617 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b2080914-20ed-42c2-9d3a-8e9f5d631ce1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.361106 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b2080914-20ed-42c2-9d3a-8e9f5d631ce1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.361544 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b2080914-20ed-42c2-9d3a-8e9f5d631ce1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:12.362242 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b2080914-20ed-42c2-9d3a-8e9f5d631ce1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.362697 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b2080914-20ed-42c2-9d3a-8e9f5d631ce1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.363139 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b2080914-20ed-42c2-9d3a-8e9f5d631ce1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:12.378808 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-b2080914-20ed-42c2-9d3a-8e9f5d631ce1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] HTTP exception thrown: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b2080914-20ed-42c2-9d3a-8e9f5d631ce1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Request method failure captured: Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: DELETE /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e HTTP/1.1 Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhplsuIjfxBizWlk2GTc6OwB0NAv2--8K3n4Uq18iQ-WuP2-sfoghLCm_b2-dA07neiLMaZMzQYZdfmVINt5LQ2wKvb3DIBqrP0lK0t1H7ep_nerjij3idaG05KL5Q04kJlFo2zNaAz6HZxQ91eaaEscvzdytHSBtlBJ9iOeHAvf3rw Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: 36bd9970f0694314b966d86f13b83d4b Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:39:12.380380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:39:12.381925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:12.381925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:39:12.381925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: 36bd9970f0694314b966d86f13b83d4b Aug 24 12:39:12.381925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:39:12.381925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeTestJSON-881897809-project Aug 24 12:39:12.381925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:39:12.381925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:39:12.381925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: ed0d97f3f08f46af851492aee6a8d0ef Aug 24 12:39:12.381925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeTestJSON-881897809-project Aug 24 12:39:12.381925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:39:12.381925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. Aug 24 12:39:12.381925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': '43372cd4-ec10-4467-a0e3-c7b1d44dc50e'} Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:12.382704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. Aug 24 12:39:12.383974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.385210 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b2080914-20ed-42c2-9d3a-8e9f5d631ce1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Returning 404 to user: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:12.385210 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b2080914-20ed-42c2-9d3a-8e9f5d631ce1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 404 len: 111 microversion: 2.1 time: 0.032881 Aug 24 12:39:12.385210 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 402/808] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:39:12 2022] DELETE /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:39:12.395993 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4c7bb6ce-a4cc-4012-8089-7e9f621284a8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:12.396713 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4c7bb6ce-a4cc-4012-8089-7e9f621284a8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: 43372cd4-ec10-4467-a0e3-c7b1d44dc50e] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:12.404172 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4c7bb6ce-a4cc-4012-8089-7e9f621284a8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.404734 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4c7bb6ce-a4cc-4012-8089-7e9f621284a8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.405092 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4c7bb6ce-a4cc-4012-8089-7e9f621284a8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:12.406174 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4c7bb6ce-a4cc-4012-8089-7e9f621284a8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.406758 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4c7bb6ce-a4cc-4012-8089-7e9f621284a8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.407224 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4c7bb6ce-a4cc-4012-8089-7e9f621284a8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:12.422033 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-4c7bb6ce-a4cc-4012-8089-7e9f621284a8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] HTTP exception thrown: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4c7bb6ce-a4cc-4012-8089-7e9f621284a8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Request method failure captured: Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e HTTP/1.1 Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhplsuIjfxBizWlk2GTc6OwB0NAv2--8K3n4Uq18iQ-WuP2-sfoghLCm_b2-dA07neiLMaZMzQYZdfmVINt5LQ2wKvb3DIBqrP0lK0t1H7ep_nerjij3idaG05KL5Q04kJlFo2zNaAz6HZxQ91eaaEscvzdytHSBtlBJ9iOeHAvf3rw Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 36bd9970f0694314b966d86f13b83d4b Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:39:12.423658 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:39:12.424973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:12.424973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:39:12.424973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 36bd9970f0694314b966d86f13b83d4b Aug 24 12:39:12.424973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:39:12.424973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-AttachVolumeTestJSON-881897809-project Aug 24 12:39:12.424973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:39:12.424973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:39:12.424973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: ed0d97f3f08f46af851492aee6a8d0ef Aug 24 12:39:12.424973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-AttachVolumeTestJSON-881897809-project Aug 24 12:39:12.424973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:39:12.424973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. Aug 24 12:39:12.424973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '43372cd4-ec10-4467-a0e3-c7b1d44dc50e'} Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:12.425765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. Aug 24 12:39:12.426980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.428367 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4c7bb6ce-a4cc-4012-8089-7e9f621284a8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Returning 404 to user: Instance 43372cd4-ec10-4467-a0e3-c7b1d44dc50e could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:12.428367 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4c7bb6ce-a4cc-4012-8089-7e9f621284a8 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e" status: 404 len: 111 microversion: 2.1 time: 0.034758 Aug 24 12:39:12.428367 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 407/809] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:12 2022] GET /compute/v2.1/servers/43372cd4-ec10-4467-a0e3-c7b1d44dc50e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:39:12.433680 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d8f648f5-b037-4695-898c-df02438676aa tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:12.434233 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d8f648f5-b037-4695-898c-df02438676aa tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:12.441566 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d8f648f5-b037-4695-898c-df02438676aa tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.442266 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d8f648f5-b037-4695-898c-df02438676aa tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.446351 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d8f648f5-b037-4695-898c-df02438676aa tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:12.447171 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d8f648f5-b037-4695-898c-df02438676aa tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.447554 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d8f648f5-b037-4695-898c-df02438676aa tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.448010 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d8f648f5-b037-4695-898c-df02438676aa tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:12.463723 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-d8f648f5-b037-4695-898c-df02438676aa tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] HTTP exception thrown: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d8f648f5-b037-4695-898c-df02438676aa tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Request method failure captured: Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: DELETE /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a HTTP/1.1 Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhplx9vIDtCGdDFFAVdrWbsbK7UFSa6YKTkdck275IH7y_8SPhXCYXZ1NCr2N8jds7FLyCnLM1I4cEXDwB-UUmQ5i0bQKYBGNDrvU9KIhgk4mW1oIvZT9U35gxW10HYEHXM0nyaJNOGGp4Wcdhh3g8tOxt83BZ0YkjKmZ0ecRcqlVlY Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: b38fa406b760405f8d3004db272f1e52 Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:39:12.465177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:39:12.467247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b38fa406b760405f8d3004db272f1e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:12.467247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:39:12.467247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: b38fa406b760405f8d3004db272f1e52 Aug 24 12:39:12.467247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:39:12.467247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeShelveTestJSON-615962332-project Aug 24 12:39:12.467247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:39:12.467247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:39:12.467247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 28dac3ee2d5c4ff5ba2d15b59e57d2a7 Aug 24 12:39:12.467247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-615962332-project Aug 24 12:39:12.467247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:39:12.467247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. Aug 24 12:39:12.467247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': 'cec78743-6cd7-4df3-a22c-72acff29cf1a'} Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:12.468354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. Aug 24 12:39:12.470219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.472016 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d8f648f5-b037-4695-898c-df02438676aa tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Returning 404 to user: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:12.472016 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d8f648f5-b037-4695-898c-df02438676aa tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 404 len: 111 microversion: 2.20 time: 0.040845 Aug 24 12:39:12.472016 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 403/810] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 12:39:12 2022] DELETE /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:39:12.477469 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-afef68b4-33dc-4e68-98fe-7e15e4698f55 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:12.478090 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-afef68b4-33dc-4e68-98fe-7e15e4698f55 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: cec78743-6cd7-4df3-a22c-72acff29cf1a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:12.485306 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-afef68b4-33dc-4e68-98fe-7e15e4698f55 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.489460 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-afef68b4-33dc-4e68-98fe-7e15e4698f55 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.489460 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-afef68b4-33dc-4e68-98fe-7e15e4698f55 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:12.489460 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-afef68b4-33dc-4e68-98fe-7e15e4698f55 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.489460 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-afef68b4-33dc-4e68-98fe-7e15e4698f55 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.490102 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-afef68b4-33dc-4e68-98fe-7e15e4698f55 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:12.503995 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-afef68b4-33dc-4e68-98fe-7e15e4698f55 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] HTTP exception thrown: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-afef68b4-33dc-4e68-98fe-7e15e4698f55 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Request method failure captured: Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a HTTP/1.1 Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhplx9vIDtCGdDFFAVdrWbsbK7UFSa6YKTkdck275IH7y_8SPhXCYXZ1NCr2N8jds7FLyCnLM1I4cEXDwB-UUmQ5i0bQKYBGNDrvU9KIhgk4mW1oIvZT9U35gxW10HYEHXM0nyaJNOGGp4Wcdhh3g8tOxt83BZ0YkjKmZ0ecRcqlVlY Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: b38fa406b760405f8d3004db272f1e52 Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:39:12.505553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:39:12.506940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b38fa406b760405f8d3004db272f1e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:12.506940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:39:12.506940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: b38fa406b760405f8d3004db272f1e52 Aug 24 12:39:12.506940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:39:12.506940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-AttachVolumeShelveTestJSON-615962332-project Aug 24 12:39:12.506940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:39:12.506940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:39:12.506940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 28dac3ee2d5c4ff5ba2d15b59e57d2a7 Aug 24 12:39:12.506940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-AttachVolumeShelveTestJSON-615962332-project Aug 24 12:39:12.506940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:39:12.506940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. Aug 24 12:39:12.506940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': 'cec78743-6cd7-4df3-a22c-72acff29cf1a'} Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:12.507786 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. Aug 24 12:39:12.509205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:12.510895 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-afef68b4-33dc-4e68-98fe-7e15e4698f55 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Returning 404 to user: Instance cec78743-6cd7-4df3-a22c-72acff29cf1a could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:12.510895 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-afef68b4-33dc-4e68-98fe-7e15e4698f55 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a" status: 404 len: 111 microversion: 2.20 time: 0.033277 Aug 24 12:39:12.510895 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 408/811] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:12 2022] GET /compute/v2.1/servers/cec78743-6cd7-4df3-a22c-72acff29cf1a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:39:13.603178 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-fe43cf94-9c9b-490f-b5c4-f94efbd549f1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:13.603846 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-fe43cf94-9c9b-490f-b5c4-f94efbd549f1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:13.611778 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fe43cf94-9c9b-490f-b5c4-f94efbd549f1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.612272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fe43cf94-9c9b-490f-b5c4-f94efbd549f1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.612718 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fe43cf94-9c9b-490f-b5c4-f94efbd549f1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.613415 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fe43cf94-9c9b-490f-b5c4-f94efbd549f1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.613875 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fe43cf94-9c9b-490f-b5c4-f94efbd549f1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.614296 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fe43cf94-9c9b-490f-b5c4-f94efbd549f1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.631400 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-fe43cf94-9c9b-490f-b5c4-f94efbd549f1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] HTTP exception thrown: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-fe43cf94-9c9b-490f-b5c4-f94efbd549f1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Request method failure captured: Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: DELETE /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab HTTP/1.1 Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhplsuIjfxBizWlk2GTc6OwB0NAv2--8K3n4Uq18iQ-WuP2-sfoghLCm_b2-dA07neiLMaZMzQYZdfmVINt5LQ2wKvb3DIBqrP0lK0t1H7ep_nerjij3idaG05KL5Q04kJlFo2zNaAz6HZxQ91eaaEscvzdytHSBtlBJ9iOeHAvf3rw Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: 36bd9970f0694314b966d86f13b83d4b Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:39:13.632988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:39:13.634396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:13.634396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:39:13.634396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: 36bd9970f0694314b966d86f13b83d4b Aug 24 12:39:13.634396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:39:13.634396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeTestJSON-881897809-project Aug 24 12:39:13.634396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:39:13.634396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:39:13.634396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: ed0d97f3f08f46af851492aee6a8d0ef Aug 24 12:39:13.634396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeTestJSON-881897809-project Aug 24 12:39:13.634396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:39:13.634396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. Aug 24 12:39:13.634396 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': 'c2cf1c28-43da-4dce-9f29-d2a486ef88ab'} Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:13.636128 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. Aug 24 12:39:13.637884 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.640249 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-fe43cf94-9c9b-490f-b5c4-f94efbd549f1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Returning 404 to user: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:13.640249 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-fe43cf94-9c9b-490f-b5c4-f94efbd549f1 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 404 len: 111 microversion: 2.1 time: 0.035796 Aug 24 12:39:13.640249 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 404/812] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:39:13 2022] DELETE /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:39:13.644882 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-282e375d-66dc-4aa3-b764-e5fb3b5068d6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:13.645488 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-282e375d-66dc-4aa3-b764-e5fb3b5068d6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] [instance: c2cf1c28-43da-4dce-9f29-d2a486ef88ab] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:13.651772 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-282e375d-66dc-4aa3-b764-e5fb3b5068d6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.652260 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-282e375d-66dc-4aa3-b764-e5fb3b5068d6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.652704 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-282e375d-66dc-4aa3-b764-e5fb3b5068d6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.653924 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-282e375d-66dc-4aa3-b764-e5fb3b5068d6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.654371 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-282e375d-66dc-4aa3-b764-e5fb3b5068d6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.655016 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-282e375d-66dc-4aa3-b764-e5fb3b5068d6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.658960 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-97682479-b809-4979-909c-86f318b7c4ca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:13.659450 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-97682479-b809-4979-909c-86f318b7c4ca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:13.665866 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-97682479-b809-4979-909c-86f318b7c4ca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.666349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-97682479-b809-4979-909c-86f318b7c4ca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.666777 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-97682479-b809-4979-909c-86f318b7c4ca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.667681 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-97682479-b809-4979-909c-86f318b7c4ca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.668185 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-97682479-b809-4979-909c-86f318b7c4ca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.668548 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-97682479-b809-4979-909c-86f318b7c4ca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.671964 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-282e375d-66dc-4aa3-b764-e5fb3b5068d6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] HTTP exception thrown: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-282e375d-66dc-4aa3-b764-e5fb3b5068d6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Request method failure captured: Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab HTTP/1.1 Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhplsuIjfxBizWlk2GTc6OwB0NAv2--8K3n4Uq18iQ-WuP2-sfoghLCm_b2-dA07neiLMaZMzQYZdfmVINt5LQ2wKvb3DIBqrP0lK0t1H7ep_nerjij3idaG05KL5Q04kJlFo2zNaAz6HZxQ91eaaEscvzdytHSBtlBJ9iOeHAvf3rw Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 36bd9970f0694314b966d86f13b83d4b Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:39:13.673486 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:39:13.674836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_36bd9970f0694314b966d86f13b83d4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:13.674836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:39:13.674836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 36bd9970f0694314b966d86f13b83d4b Aug 24 12:39:13.674836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-AttachVolumeTestJSON-881897809 Aug 24 12:39:13.674836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-AttachVolumeTestJSON-881897809-project Aug 24 12:39:13.674836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:39:13.674836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:39:13.674836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: ed0d97f3f08f46af851492aee6a8d0ef Aug 24 12:39:13.674836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-AttachVolumeTestJSON-881897809-project Aug 24 12:39:13.674836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:39:13.674836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. Aug 24 12:39:13.674836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': 'c2cf1c28-43da-4dce-9f29-d2a486ef88ab'} Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:13.675921 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. Aug 24 12:39:13.677477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.679044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-282e375d-66dc-4aa3-b764-e5fb3b5068d6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] Returning 404 to user: Instance c2cf1c28-43da-4dce-9f29-d2a486ef88ab could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:13.679044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-282e375d-66dc-4aa3-b764-e5fb3b5068d6 tempest-AttachVolumeTestJSON-881897809 tempest-AttachVolumeTestJSON-881897809-project] 10.222.0.58 "GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab" status: 404 len: 111 microversion: 2.1 time: 0.033746 Aug 24 12:39:13.679044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 409/813] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:13 2022] GET /compute/v2.1/servers/c2cf1c28-43da-4dce-9f29-d2a486ef88ab => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:39:13.689936 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-97682479-b809-4979-909c-86f318b7c4ca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] HTTP exception thrown: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-97682479-b809-4979-909c-86f318b7c4ca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Request method failure captured: Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: DELETE /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 HTTP/1.1 Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhplx9vIDtCGdDFFAVdrWbsbK7UFSa6YKTkdck275IH7y_8SPhXCYXZ1NCr2N8jds7FLyCnLM1I4cEXDwB-UUmQ5i0bQKYBGNDrvU9KIhgk4mW1oIvZT9U35gxW10HYEHXM0nyaJNOGGp4Wcdhh3g8tOxt83BZ0YkjKmZ0ecRcqlVlY Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: b38fa406b760405f8d3004db272f1e52 Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:39:13.691485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:39:13.692938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b38fa406b760405f8d3004db272f1e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:13.692938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:39:13.692938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: b38fa406b760405f8d3004db272f1e52 Aug 24 12:39:13.692938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:39:13.692938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-AttachVolumeShelveTestJSON-615962332-project Aug 24 12:39:13.692938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:39:13.692938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:39:13.692938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 28dac3ee2d5c4ff5ba2d15b59e57d2a7 Aug 24 12:39:13.692938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-615962332-project Aug 24 12:39:13.692938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:39:13.692938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. Aug 24 12:39:13.692938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': 'e09b5ebb-0578-465d-a6ad-03383fdeca05'} Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:13.693678 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. Aug 24 12:39:13.694897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.697313 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-97682479-b809-4979-909c-86f318b7c4ca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Returning 404 to user: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:13.697313 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-97682479-b809-4979-909c-86f318b7c4ca tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 404 len: 111 microversion: 2.20 time: 0.038526 Aug 24 12:39:13.697313 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 405/814] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 12:39:13 2022] DELETE /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 12:39:13.705377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d4a2ccc0-e555-454d-a975-8fb1cbf9b7a1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:13.706352 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d4a2ccc0-e555-454d-a975-8fb1cbf9b7a1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] [instance: e09b5ebb-0578-465d-a6ad-03383fdeca05] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:13.712970 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d4a2ccc0-e555-454d-a975-8fb1cbf9b7a1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.713513 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d4a2ccc0-e555-454d-a975-8fb1cbf9b7a1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.713944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d4a2ccc0-e555-454d-a975-8fb1cbf9b7a1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.714630 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d4a2ccc0-e555-454d-a975-8fb1cbf9b7a1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.715077 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d4a2ccc0-e555-454d-a975-8fb1cbf9b7a1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.715502 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d4a2ccc0-e555-454d-a975-8fb1cbf9b7a1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.729759 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-d4a2ccc0-e555-454d-a975-8fb1cbf9b7a1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] HTTP exception thrown: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d4a2ccc0-e555-454d-a975-8fb1cbf9b7a1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Request method failure captured: Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 HTTP/1.1 Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhplx9vIDtCGdDFFAVdrWbsbK7UFSa6YKTkdck275IH7y_8SPhXCYXZ1NCr2N8jds7FLyCnLM1I4cEXDwB-UUmQ5i0bQKYBGNDrvU9KIhgk4mW1oIvZT9U35gxW10HYEHXM0nyaJNOGGp4Wcdhh3g8tOxt83BZ0YkjKmZ0ecRcqlVlY Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: b38fa406b760405f8d3004db272f1e52 Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:39:13.731923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:39:13.733444 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b38fa406b760405f8d3004db272f1e52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b38fa406b760405f8d3004db272f1e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:13.733444 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:39:13.733444 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: b38fa406b760405f8d3004db272f1e52 Aug 24 12:39:13.733444 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-615962332 Aug 24 12:39:13.733444 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-AttachVolumeShelveTestJSON-615962332-project Aug 24 12:39:13.733444 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:39:13.733444 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:39:13.733444 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 28dac3ee2d5c4ff5ba2d15b59e57d2a7 Aug 24 12:39:13.733444 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-AttachVolumeShelveTestJSON-615962332-project Aug 24 12:39:13.733444 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:39:13.733444 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. Aug 24 12:39:13.733444 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': 'e09b5ebb-0578-465d-a6ad-03383fdeca05'} Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:13.734203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. Aug 24 12:39:13.735410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:13.738377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d4a2ccc0-e555-454d-a975-8fb1cbf9b7a1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] Returning 404 to user: Instance e09b5ebb-0578-465d-a6ad-03383fdeca05 could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:13.738377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d4a2ccc0-e555-454d-a975-8fb1cbf9b7a1 tempest-AttachVolumeShelveTestJSON-615962332 tempest-AttachVolumeShelveTestJSON-615962332-project] 10.222.0.58 "GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05" status: 404 len: 111 microversion: 2.20 time: 0.033720 Aug 24 12:39:13.738377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 410/815] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:13 2022] GET /compute/v2.1/servers/e09b5ebb-0578-465d-a6ad-03383fdeca05 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:39:25.453947 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-80debdec-5160-4d9e-9993-6806dc1c39b9 tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] Calling method '.version_select at 0x7f469fcf7af0>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:25.460900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:25.461790 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:25.505976 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-80debdec-5160-4d9e-9993-6806dc1c39b9 tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/72fc57bf-b0a2-478b-81f7-643e0eebd1cb" status: 200 len: 351 microversion: 2.1 time: 0.057050 Aug 24 12:39:25.506563 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 406/816] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 12:39:25 2022] GET /compute/v2.1/os-volumes/72fc57bf-b0a2-478b-81f7-643e0eebd1cb => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:32.088844 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b529e076-c4b2-467f-a437-fbb1862e948d tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] Calling method '.version_select at 0x7f4696b6f4c0>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:32.095518 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:32.096281 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:32.137272 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b529e076-c4b2-467f-a437-fbb1862e948d tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/57cee948-4b9f-460e-bcf0-a39bfe696a56" status: 200 len: 350 microversion: 2.1 time: 0.052186 Aug 24 12:39:32.137866 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 411/817] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 12:39:32 2022] GET /compute/v2.1/os-volumes/57cee948-4b9f-460e-bcf0-a39bfe696a56 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:39:33.489670 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b7a8539f-5a61-4950-a80a-6f4ddeddbce1 tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] Calling method '.version_select at 0x7f469fd42040>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:33.537392 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b7a8539f-5a61-4950-a80a-6f4ddeddbce1 tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/382b2f51-8c46-4811-9b9d-8a0187b1a983" status: 200 len: 349 microversion: 2.1 time: 0.051855 Aug 24 12:39:33.537971 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 407/818] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 12:39:33 2022] GET /compute/v2.1/os-volumes/382b2f51-8c46-4811-9b9d-8a0187b1a983 => generated 349 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:33.551948 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-cfc6cd22-1d2b-4ab8-a99d-899622c659b7 tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] Calling method '.version_select at 0x7f4696ab8a60>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:33.634244 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-cfc6cd22-1d2b-4ab8-a99d-899622c659b7 tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.086470 Aug 24 12:39:33.634814 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 412/819] 10.222.0.58 () {58 vars in 1134 bytes} [Wed Aug 24 12:39:33 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:33.648132 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-60466323-3722-4774-9306-3339aa1a8cbc tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] Calling method '.version_select at 0x7f469fd42af0>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:33.731399 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-60466323-3722-4774-9306-3339aa1a8cbc tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.086459 Aug 24 12:39:33.731994 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 408/820] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 24 12:39:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:33.747539 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-da1aea92-2c78-47f8-bfe0-6c0fd66d4a93 tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] Calling method '.version_select at 0x7f4696ac3dc0>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:33.830264 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-da1aea92-2c78-47f8-bfe0-6c0fd66d4a93 tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.087299 Aug 24 12:39:33.830834 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 413/821] 10.222.0.58 () {58 vars in 1134 bytes} [Wed Aug 24 12:39:33 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:33.843598 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-7fdd1222-6eea-4674-ab7c-39188f0a0a4a tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] Calling method '.version_select at 0x7f469fd42a60>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:33.929724 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-7fdd1222-6eea-4674-ab7c-39188f0a0a4a tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090242 Aug 24 12:39:33.930280 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 409/822] 10.222.0.58 () {58 vars in 1167 bytes} [Wed Aug 24 12:39:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:33.943297 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-eb8f622c-3929-4a0e-adea-4854a71c115e tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] Calling method '.version_select at 0x7f4696ac3550>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:34.025396 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-eb8f622c-3929-4a0e-adea-4854a71c115e tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.085697 Aug 24 12:39:34.025963 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 414/823] 10.222.0.58 () {58 vars in 1170 bytes} [Wed Aug 24 12:39:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:34.039264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9d82a52d-4601-425a-b465-5d6e9ef6ea92 tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] Calling method '.version_select at 0x7f469fcf7700>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:34.123218 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9d82a52d-4601-425a-b465-5d6e9ef6ea92 tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.087481 Aug 24 12:39:34.123816 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 410/824] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 12:39:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:34.136216 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d5e71c74-3e56-48c8-8a93-31f6d78f30e0 tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] Calling method '.version_select at 0x7f4696ae9550>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:34.218359 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d5e71c74-3e56-48c8-8a93-31f6d78f30e0 tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085708 Aug 24 12:39:34.218950 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 415/825] 10.222.0.58 () {58 vars in 1188 bytes} [Wed Aug 24 12:39:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:34.232926 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b5a2d57d-62d6-443b-aacd-30b4074777af tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] Calling method '.version_select at 0x7f4697365d30>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:34.315646 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b5a2d57d-62d6-443b-aacd-30b4074777af tempest-VolumesTestJSON-234046898 tempest-VolumesTestJSON-234046898-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.087380 Aug 24 12:39:34.316280 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 411/826] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 12:39:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:38.106780 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a86d2158-0bc6-4053-abba-76bec67e4fff tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:38.107908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-a86d2158-0bc6-4053-abba-76bec67e4fff tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:38.117004 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a86d2158-0bc6-4053-abba-76bec67e4fff tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:38.117487 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a86d2158-0bc6-4053-abba-76bec67e4fff tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:38.117916 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a86d2158-0bc6-4053-abba-76bec67e4fff tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:38.118598 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a86d2158-0bc6-4053-abba-76bec67e4fff tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:38.119043 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a86d2158-0bc6-4053-abba-76bec67e4fff tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:38.119457 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a86d2158-0bc6-4053-abba-76bec67e4fff tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:38.203284 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-a86d2158-0bc6-4053-abba-76bec67e4fff tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lazy-loading 'services' on Instance uuid a56fd4a9-d546-41d8-84f3-5131a8e40bc9 {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:39:38.286196 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a86d2158-0bc6-4053-abba-76bec67e4fff tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9/os-volume_attachments/e7eaa07d-a363-4937-a9a0-ff1eee6f0ad1" status: 202 len: 0 microversion: 2.1 time: 0.183420 Aug 24 12:39:38.287055 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 416/827] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 12:39:38 2022] DELETE /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9/os-volume_attachments/e7eaa07d-a363-4937-a9a0-ff1eee6f0ad1 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:39:42.672922 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2aff1cb9-2e09-4bf4-be56-46d5285dfbdb tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:42.673409 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2aff1cb9-2e09-4bf4-be56-46d5285dfbdb tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:42.679290 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2aff1cb9-2e09-4bf4-be56-46d5285dfbdb tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:42.679806 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2aff1cb9-2e09-4bf4-be56-46d5285dfbdb tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:42.680225 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2aff1cb9-2e09-4bf4-be56-46d5285dfbdb tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:42.680908 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2aff1cb9-2e09-4bf4-be56-46d5285dfbdb tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:42.681350 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2aff1cb9-2e09-4bf4-be56-46d5285dfbdb tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:42.681785 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2aff1cb9-2e09-4bf4-be56-46d5285dfbdb tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:42.714232 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2aff1cb9-2e09-4bf4-be56-46d5285dfbdb tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Going to try to terminate instance {{(pid=127307) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:39:42.803034 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2aff1cb9-2e09-4bf4-be56-46d5285dfbdb tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 204 len: 0 microversion: 2.1 time: 0.133904 Aug 24 12:39:42.803859 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 412/828] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:39:42 2022] DELETE /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:39:42.819008 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-0cddff34-3efb-47e5-b7e8-c4b4c14d251f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:42.822749 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-0cddff34-3efb-47e5-b7e8-c4b4c14d251f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:42.828320 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0cddff34-3efb-47e5-b7e8-c4b4c14d251f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:42.829033 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0cddff34-3efb-47e5-b7e8-c4b4c14d251f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:42.829734 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0cddff34-3efb-47e5-b7e8-c4b4c14d251f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:42.830533 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0cddff34-3efb-47e5-b7e8-c4b4c14d251f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:42.831088 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0cddff34-3efb-47e5-b7e8-c4b4c14d251f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:42.831614 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0cddff34-3efb-47e5-b7e8-c4b4c14d251f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:42.987218 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-0cddff34-3efb-47e5-b7e8-c4b4c14d251f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:42.995837 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-0cddff34-3efb-47e5-b7e8-c4b4c14d251f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 200 len: 1513 microversion: 2.1 time: 0.185843 Aug 24 12:39:42.996494 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 417/829] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:42 2022] GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:39:44.017971 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-da0f597b-6aef-434e-a02d-132f3841c435 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:44.018596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-da0f597b-6aef-434e-a02d-132f3841c435 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:44.024875 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-da0f597b-6aef-434e-a02d-132f3841c435 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:44.025354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-da0f597b-6aef-434e-a02d-132f3841c435 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:44.025782 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-da0f597b-6aef-434e-a02d-132f3841c435 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:44.026460 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-da0f597b-6aef-434e-a02d-132f3841c435 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:44.026906 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-da0f597b-6aef-434e-a02d-132f3841c435 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:44.027319 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-da0f597b-6aef-434e-a02d-132f3841c435 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:44.153462 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-da0f597b-6aef-434e-a02d-132f3841c435 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:44.161349 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-da0f597b-6aef-434e-a02d-132f3841c435 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 200 len: 1513 microversion: 2.1 time: 0.147730 Aug 24 12:39:44.161913 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 413/830] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:44 2022] GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:45.182693 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9de13d95-0b61-44b7-9516-7ffb6d399646 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:45.183285 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9de13d95-0b61-44b7-9516-7ffb6d399646 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:45.190726 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9de13d95-0b61-44b7-9516-7ffb6d399646 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:45.191237 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9de13d95-0b61-44b7-9516-7ffb6d399646 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:45.191701 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9de13d95-0b61-44b7-9516-7ffb6d399646 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:45.192406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9de13d95-0b61-44b7-9516-7ffb6d399646 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:45.192859 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9de13d95-0b61-44b7-9516-7ffb6d399646 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:45.193278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9de13d95-0b61-44b7-9516-7ffb6d399646 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:45.329753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9de13d95-0b61-44b7-9516-7ffb6d399646 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:45.337801 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9de13d95-0b61-44b7-9516-7ffb6d399646 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 200 len: 1513 microversion: 2.1 time: 0.158912 Aug 24 12:39:45.338462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 418/831] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:45 2022] GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:46.358866 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2da5e671-6b80-4cab-81b4-3b84693e7187 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:46.359488 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2da5e671-6b80-4cab-81b4-3b84693e7187 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:46.368580 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2da5e671-6b80-4cab-81b4-3b84693e7187 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:46.369125 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2da5e671-6b80-4cab-81b4-3b84693e7187 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:46.369575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2da5e671-6b80-4cab-81b4-3b84693e7187 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:46.374265 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2da5e671-6b80-4cab-81b4-3b84693e7187 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:46.374265 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2da5e671-6b80-4cab-81b4-3b84693e7187 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:46.374265 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2da5e671-6b80-4cab-81b4-3b84693e7187 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:46.530831 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2da5e671-6b80-4cab-81b4-3b84693e7187 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:46.538823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2da5e671-6b80-4cab-81b4-3b84693e7187 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 200 len: 1513 microversion: 2.1 time: 0.184365 Aug 24 12:39:46.539392 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 414/832] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:46 2022] GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:47.174432 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-8c7612a3-8bc6-4186-acce-f298f4cbb747 req-b2b74115-2995-4e7a-8ffd-45f8e4180d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56fd4a9-d546-41d8-84f3-5131a8e40bc9", "name": "network-vif-deleted", "tag": "767a0ee9-16a6-4a34-ba33-3bea6b5cb2b0"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:47.187221 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-8c7612a3-8bc6-4186-acce-f298f4cbb747 req-b2b74115-2995-4e7a-8ffd-45f8e4180d38 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:47.187917 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-8c7612a3-8bc6-4186-acce-f298f4cbb747 req-b2b74115-2995-4e7a-8ffd-45f8e4180d38 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:47.188365 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-8c7612a3-8bc6-4186-acce-f298f4cbb747 req-b2b74115-2995-4e7a-8ffd-45f8e4180d38 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:47.201744 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-8c7612a3-8bc6-4186-acce-f298f4cbb747 req-b2b74115-2995-4e7a-8ffd-45f8e4180d38 service nova] Creating event network-vif-deleted:767a0ee9-16a6-4a34-ba33-3bea6b5cb2b0 for instance a56fd4a9-d546-41d8-84f3-5131a8e40bc9 on hv-cinder-84890 Aug 24 12:39:47.207572 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-8c7612a3-8bc6-4186-acce-f298f4cbb747 req-b2b74115-2995-4e7a-8ffd-45f8e4180d38 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036648 Aug 24 12:39:47.208756 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 419/833] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:47.561580 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-7e1ffcdb-93eb-4d9b-a531-310a4aecc1e7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:47.562048 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-7e1ffcdb-93eb-4d9b-a531-310a4aecc1e7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:47.585990 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7e1ffcdb-93eb-4d9b-a531-310a4aecc1e7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:47.588079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7e1ffcdb-93eb-4d9b-a531-310a4aecc1e7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:47.588902 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7e1ffcdb-93eb-4d9b-a531-310a4aecc1e7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:47.592546 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7e1ffcdb-93eb-4d9b-a531-310a4aecc1e7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:47.592546 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7e1ffcdb-93eb-4d9b-a531-310a4aecc1e7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:47.592546 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7e1ffcdb-93eb-4d9b-a531-310a4aecc1e7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:47.666347 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7e1ffcdb-93eb-4d9b-a531-310a4aecc1e7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:47.667057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7e1ffcdb-93eb-4d9b-a531-310a4aecc1e7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:47.675958 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7e1ffcdb-93eb-4d9b-a531-310a4aecc1e7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:47.676445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.objects.instance [None req-7e1ffcdb-93eb-4d9b-a531-310a4aecc1e7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lazy-loading 'fault' on Instance uuid a56fd4a9-d546-41d8-84f3-5131a8e40bc9 {{(pid=127307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:39:47.749195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7e1ffcdb-93eb-4d9b-a531-310a4aecc1e7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:47.759164 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-7e1ffcdb-93eb-4d9b-a531-310a4aecc1e7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 200 len: 1307 microversion: 2.1 time: 0.202312 Aug 24 12:39:47.760276 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 415/834] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:47 2022] GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 1307 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:39:48.783611 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a5829131-bdf2-4279-94b8-ab5ab5f7a41b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:48.784440 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-a5829131-bdf2-4279-94b8-ab5ab5f7a41b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: a56fd4a9-d546-41d8-84f3-5131a8e40bc9] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:48.796349 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a5829131-bdf2-4279-94b8-ab5ab5f7a41b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:48.797000 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a5829131-bdf2-4279-94b8-ab5ab5f7a41b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:48.797631 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a5829131-bdf2-4279-94b8-ab5ab5f7a41b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:48.798331 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a5829131-bdf2-4279-94b8-ab5ab5f7a41b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:48.799382 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a5829131-bdf2-4279-94b8-ab5ab5f7a41b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:48.800058 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a5829131-bdf2-4279-94b8-ab5ab5f7a41b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:48.817251 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-a5829131-bdf2-4279-94b8-ab5ab5f7a41b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] HTTP exception thrown: Instance a56fd4a9-d546-41d8-84f3-5131a8e40bc9 could not be found. Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a5829131-bdf2-4279-94b8-ab5ab5f7a41b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Request method failure captured: Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 HTTP/1.1 Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhvMj0O9erA_ZCsnM9t5bcbMUipckqt3jnZDXPhI5Yn7-2FUoA7cjS_mOw5fn7IgFP1j3Pf7vJ3cwVXOdbxhVxFkmSD8wHqgBJO0WAGkWG1IW6gEC3wTtFQSkGvoT6mDHg0jcYIG_IaIqTkly74ISGq7uqaqjSUXqcCbsNoE6NoyfUM Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 474008375491499b85702c8824bd1981 Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1619250705 Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:39:48.819520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:39:48.821063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474008375491499b85702c8824bd1981"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474008375491499b85702c8824bd1981"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/474008375491499b85702c8824bd1981"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_474008375491499b85702c8824bd1981"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:39:48.821063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-VolumesSnapshotTestJSON-1619250705 Aug 24 12:39:48.821063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 474008375491499b85702c8824bd1981 Aug 24 12:39:48.821063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1619250705 Aug 24 12:39:48.821063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-VolumesSnapshotTestJSON-1619250705-project Aug 24 12:39:48.821063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:39:48.821063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:39:48.821063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 9c40bc0027e94421a1da7b8016307b67 Aug 24 12:39:48.821063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-VolumesSnapshotTestJSON-1619250705-project Aug 24 12:39:48.821063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:39:48.821063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance a56fd4a9-d546-41d8-84f3-5131a8e40bc9 could not be found. Aug 24 12:39:48.821063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': 'a56fd4a9-d546-41d8-84f3-5131a8e40bc9'} Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a56fd4a9-d546-41d8-84f3-5131a8e40bc9 could not be found. Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:39:48.821954 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a56fd4a9-d546-41d8-84f3-5131a8e40bc9 could not be found. Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a56fd4a9-d546-41d8-84f3-5131a8e40bc9 could not be found. Aug 24 12:39:48.823388 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:39:48.824955 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a5829131-bdf2-4279-94b8-ab5ab5f7a41b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Returning 404 to user: Instance a56fd4a9-d546-41d8-84f3-5131a8e40bc9 could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:39:48.824955 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a5829131-bdf2-4279-94b8-ab5ab5f7a41b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9" status: 404 len: 111 microversion: 2.1 time: 0.042774 Aug 24 12:39:48.824955 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 420/835] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:39:48 2022] GET /compute/v2.1/servers/a56fd4a9-d546-41d8-84f3-5131a8e40bc9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:01.907749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-109191514", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "networks": [{"uuid": "96243d03-54a0-41df-9dbd-05cde8397c1a"}]}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:01.916615 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:01.917268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:01.968029 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.network.neutron [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] validate_networks() for [('96243d03-54a0-41df-9dbd-05cde8397c1a', None, None, None, None, None)] {{(pid=127307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:40:02.626273 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Flavor limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:40:02.626818 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Image limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:40:02.627400 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Flavor pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:40:02.627853 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Image pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:40:02.628704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:40:02.638958 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:02.639512 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:02.639920 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:02.640651 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:02.641194 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:02.641703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:02.660998 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Getting quotas for project 474008375491499b85702c8824bd1981. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:40:02.665746 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Getting quotas for user 9c40bc0027e94421a1da7b8016307b67 and project 474008375491499b85702c8824bd1981. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:40:02.680247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Going to run 1 instances... {{(pid=127307) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:40:02.683245 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:40:02.739733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-786683f0-ae3a-4eaf-acc6-cf0e1048609c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836230 Aug 24 12:40:02.740594 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 416/836] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:40:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:40:02.751747 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4594f8f2-c4d7-40d7-987c-7e141a30cb25 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:02.752368 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4594f8f2-c4d7-40d7-987c-7e141a30cb25 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:02.754612 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=10 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:02.755501 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:02.811724 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4594f8f2-c4d7-40d7-987c-7e141a30cb25 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:02.818964 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4594f8f2-c4d7-40d7-987c-7e141a30cb25 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1218 microversion: 2.1 time: 0.071664 Aug 24 12:40:02.819530 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 421/837] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:02 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:03.840333 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-2da29553-c0a4-4118-a5d0-6299ea52e65c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:03.841592 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-2da29553-c0a4-4118-a5d0-6299ea52e65c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:03.849479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2da29553-c0a4-4118-a5d0-6299ea52e65c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:03.850127 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2da29553-c0a4-4118-a5d0-6299ea52e65c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:03.850666 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2da29553-c0a4-4118-a5d0-6299ea52e65c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:03.851471 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2da29553-c0a4-4118-a5d0-6299ea52e65c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:03.852334 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2da29553-c0a4-4118-a5d0-6299ea52e65c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:03.852863 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-2da29553-c0a4-4118-a5d0-6299ea52e65c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:03.935909 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-2da29553-c0a4-4118-a5d0-6299ea52e65c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:03.944073 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-2da29553-c0a4-4118-a5d0-6299ea52e65c tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1222 microversion: 2.1 time: 0.107905 Aug 24 12:40:03.948042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 417/838] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:03 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:04.964957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e85eceb2-f22f-4aed-9a56-00b9de70a18b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:04.965671 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e85eceb2-f22f-4aed-9a56-00b9de70a18b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:04.972300 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e85eceb2-f22f-4aed-9a56-00b9de70a18b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.973011 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e85eceb2-f22f-4aed-9a56-00b9de70a18b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.973500 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e85eceb2-f22f-4aed-9a56-00b9de70a18b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.974208 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e85eceb2-f22f-4aed-9a56-00b9de70a18b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.974728 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e85eceb2-f22f-4aed-9a56-00b9de70a18b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.975157 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e85eceb2-f22f-4aed-9a56-00b9de70a18b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:05.054709 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e85eceb2-f22f-4aed-9a56-00b9de70a18b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:05.065754 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e85eceb2-f22f-4aed-9a56-00b9de70a18b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1222 microversion: 2.1 time: 0.104539 Aug 24 12:40:05.066340 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 422/839] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:04 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:06.086334 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-271d2073-39fd-4d59-8193-620bf5313457 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:06.087702 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-271d2073-39fd-4d59-8193-620bf5313457 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:06.101243 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-271d2073-39fd-4d59-8193-620bf5313457 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:06.101959 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-271d2073-39fd-4d59-8193-620bf5313457 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:06.102612 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-271d2073-39fd-4d59-8193-620bf5313457 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:06.104000 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-271d2073-39fd-4d59-8193-620bf5313457 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:06.104879 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-271d2073-39fd-4d59-8193-620bf5313457 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:06.105604 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-271d2073-39fd-4d59-8193-620bf5313457 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:06.223459 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-271d2073-39fd-4d59-8193-620bf5313457 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:06.233138 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-271d2073-39fd-4d59-8193-620bf5313457 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1288 microversion: 2.1 time: 0.150568 Aug 24 12:40:06.234133 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 418/840] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:06 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1288 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:07.267548 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-51a46b10-11d0-41be-911a-965155351a01 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:07.267548 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-51a46b10-11d0-41be-911a-965155351a01 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:07.268188 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-51a46b10-11d0-41be-911a-965155351a01 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:07.269294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-51a46b10-11d0-41be-911a-965155351a01 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:07.270131 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-51a46b10-11d0-41be-911a-965155351a01 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:07.271837 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-51a46b10-11d0-41be-911a-965155351a01 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:07.272812 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-51a46b10-11d0-41be-911a-965155351a01 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:07.273455 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-51a46b10-11d0-41be-911a-965155351a01 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:07.526622 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-51a46b10-11d0-41be-911a-965155351a01 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:07.534758 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-51a46b10-11d0-41be-911a-965155351a01 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1318 microversion: 2.1 time: 0.283567 Aug 24 12:40:07.535567 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 423/841] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:07 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:08.389943 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-e83c57f1-ef46-4bbf-ab0f-1a82d1b6de54 req-52905ded-d878-4404-b125-58336abc40a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c606e495-b7a7-4d6e-b5a5-5ff311442a3a", "tag": "4a8e2efd-9085-42b3-aceb-2009f0c5c0ad"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:08.404284 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-e83c57f1-ef46-4bbf-ab0f-1a82d1b6de54 req-52905ded-d878-4404-b125-58336abc40a1 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:08.405792 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-e83c57f1-ef46-4bbf-ab0f-1a82d1b6de54 req-52905ded-d878-4404-b125-58336abc40a1 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:08.406464 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-e83c57f1-ef46-4bbf-ab0f-1a82d1b6de54 req-52905ded-d878-4404-b125-58336abc40a1 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:08.464559 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-e83c57f1-ef46-4bbf-ab0f-1a82d1b6de54 req-52905ded-d878-4404-b125-58336abc40a1 service nova] Creating event network-changed:4a8e2efd-9085-42b3-aceb-2009f0c5c0ad for instance c606e495-b7a7-4d6e-b5a5-5ff311442a3a on hv-cinder-84890 Aug 24 12:40:08.477789 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-e83c57f1-ef46-4bbf-ab0f-1a82d1b6de54 req-52905ded-d878-4404-b125-58336abc40a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091868 Aug 24 12:40:08.480193 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 419/842] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:08.556881 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e7d1155f-6d42-437b-9e0f-2d648a22e191 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:08.557516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e7d1155f-6d42-437b-9e0f-2d648a22e191 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:08.569098 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e7d1155f-6d42-437b-9e0f-2d648a22e191 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:08.569596 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e7d1155f-6d42-437b-9e0f-2d648a22e191 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:08.570038 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e7d1155f-6d42-437b-9e0f-2d648a22e191 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:08.570806 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e7d1155f-6d42-437b-9e0f-2d648a22e191 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:08.572258 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e7d1155f-6d42-437b-9e0f-2d648a22e191 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:08.572738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e7d1155f-6d42-437b-9e0f-2d648a22e191 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:08.803764 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e7d1155f-6d42-437b-9e0f-2d648a22e191 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:08.838151 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e7d1155f-6d42-437b-9e0f-2d648a22e191 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1318 microversion: 2.1 time: 0.285239 Aug 24 12:40:08.838858 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 424/843] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:08 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:09.604921 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1463073619", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1946886811", "security_groups": [{"name": "tempest-secgroup-smoke-428063021"}], "block_device_mapping_v2": [{"uuid": "a3c88201-14aa-496b-8315-77b42f537e35", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "918842e4-eadb-4db7-819f-681445ef12b9"}]}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:09.729652 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.network.neutron [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] validate_networks() for [('918842e4-eadb-4db7-819f-681445ef12b9', None, None, None, None, None)] {{(pid=127307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:40:09.859577 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-49eb8e05-a6a8-4939-8925-43a04ba181a4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:09.860377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-49eb8e05-a6a8-4939-8925-43a04ba181a4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:09.867871 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-49eb8e05-a6a8-4939-8925-43a04ba181a4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:09.869027 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-49eb8e05-a6a8-4939-8925-43a04ba181a4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:09.869689 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-49eb8e05-a6a8-4939-8925-43a04ba181a4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:09.870946 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-49eb8e05-a6a8-4939-8925-43a04ba181a4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:09.871576 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-49eb8e05-a6a8-4939-8925-43a04ba181a4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:09.872094 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-49eb8e05-a6a8-4939-8925-43a04ba181a4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:10.093785 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-49eb8e05-a6a8-4939-8925-43a04ba181a4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:10.109718 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-49eb8e05-a6a8-4939-8925-43a04ba181a4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1318 microversion: 2.1 time: 0.254865 Aug 24 12:40:10.111323 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 425/844] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:09 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:10.120495 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1875488841", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "networks": [{"uuid": "48e7bf8b-f9f8-45a5-b18e-b0f0f9c70061"}]}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:10.198855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.network.neutron [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] validate_networks() for [('48e7bf8b-f9f8-45a5-b18e-b0f0f9c70061', None, None, None, None, None)] {{(pid=127308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:40:10.388701 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Flavor limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:40:10.389127 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Image limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:40:10.389604 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Flavor pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:40:10.390014 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Image pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:40:10.390414 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:40:10.402577 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:10.404955 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:10.408865 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:10.409873 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:10.410517 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:10.411107 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:10.435782 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Getting quotas for project aee96e55a6a34dbb81847961d87abad0. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:40:10.446265 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Getting quotas for user 18f8f419b523440f8a4ca06dc83bff40 and project aee96e55a6a34dbb81847961d87abad0. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:40:10.525183 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Going to run 1 instances... {{(pid=127307) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:40:10.527592 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3c88201-14aa-496b-8315-77b42f537e35',volume_size=None,volume_type=None)] {{(pid=127307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:40:10.694148 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8a6dd06c-d5e7-4bf4-829b-c3be98a8d796 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.093893 Aug 24 12:40:10.695615 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 420/845] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:40:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:40:10.708606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-bcbf07fb-63ba-4067-9d7e-d6fc1a7c46d0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:10.709392 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-bcbf07fb-63ba-4067-9d7e-d6fc1a7c46d0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:10.796788 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-bcbf07fb-63ba-4067-9d7e-d6fc1a7c46d0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:10.805300 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-bcbf07fb-63ba-4067-9d7e-d6fc1a7c46d0 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1095 microversion: 2.1 time: 0.100992 Aug 24 12:40:10.805878 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 421/846] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:10 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1095 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:10.963564 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Flavor limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:40:10.964091 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Image limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:40:10.964592 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Flavor pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:40:10.965006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Image pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:40:10.965693 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:40:10.980722 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:10.982147 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:10.982733 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:10.983896 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:10.984870 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:10.985727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.008990 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Getting quotas for project a6ce654b8dc4435981cb395c4b887ae7. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:40:11.015253 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Getting quotas for user 25fad82cbf944d7db13d6bf33d3297a1 and project a6ce654b8dc4435981cb395c4b887ae7. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:40:11.027489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Going to run 1 instances... {{(pid=127308) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:40:11.031531 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:40:11.100733 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-da05a53b-1a17-45f4-89bf-453936e92e84 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.986452 Aug 24 12:40:11.101945 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 426/847] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:40:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:40:11.130794 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-176be67f-fc38-4fce-8975-dd93721a5f3f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:11.131414 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-176be67f-fc38-4fce-8975-dd93721a5f3f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:11.131999 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9cad5589-34fe-4223-b8fc-b1f0579b735d tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:11.134773 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-9cad5589-34fe-4223-b8fc-b1f0579b735d tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:11.140678 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-176be67f-fc38-4fce-8975-dd93721a5f3f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:11.141176 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-176be67f-fc38-4fce-8975-dd93721a5f3f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:11.141613 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-176be67f-fc38-4fce-8975-dd93721a5f3f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.142318 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-176be67f-fc38-4fce-8975-dd93721a5f3f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:11.142769 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-176be67f-fc38-4fce-8975-dd93721a5f3f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:11.143192 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-176be67f-fc38-4fce-8975-dd93721a5f3f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.291108 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-9cad5589-34fe-4223-b8fc-b1f0579b735d tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:11.306763 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9cad5589-34fe-4223-b8fc-b1f0579b735d tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1214 microversion: 2.1 time: 0.197052 Aug 24 12:40:11.311673 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 422/848] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:11 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1214 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:11.467579 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-176be67f-fc38-4fce-8975-dd93721a5f3f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:11.477429 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-176be67f-fc38-4fce-8975-dd93721a5f3f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1318 microversion: 2.1 time: 0.350416 Aug 24 12:40:11.478537 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 427/849] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:11 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:11.826568 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-31423599-eb98-4240-9b4d-ea47093d3c56 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:11.827188 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-31423599-eb98-4240-9b4d-ea47093d3c56 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:11.834233 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31423599-eb98-4240-9b4d-ea47093d3c56 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:11.834726 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31423599-eb98-4240-9b4d-ea47093d3c56 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:11.835168 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31423599-eb98-4240-9b4d-ea47093d3c56 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.835903 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31423599-eb98-4240-9b4d-ea47093d3c56 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:11.836369 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31423599-eb98-4240-9b4d-ea47093d3c56 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:11.836797 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-31423599-eb98-4240-9b4d-ea47093d3c56 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.932786 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-31423599-eb98-4240-9b4d-ea47093d3c56 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:11.949970 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-31423599-eb98-4240-9b4d-ea47093d3c56 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1193 microversion: 2.1 time: 0.126641 Aug 24 12:40:11.952426 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 423/850] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:11 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1193 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:12.333142 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4e51a445-220c-4540-a43b-e1db87b86888 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:12.333742 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4e51a445-220c-4540-a43b-e1db87b86888 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:12.340239 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e51a445-220c-4540-a43b-e1db87b86888 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:12.341561 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e51a445-220c-4540-a43b-e1db87b86888 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:12.342512 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e51a445-220c-4540-a43b-e1db87b86888 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:12.343413 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e51a445-220c-4540-a43b-e1db87b86888 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:12.344087 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e51a445-220c-4540-a43b-e1db87b86888 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:12.344577 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4e51a445-220c-4540-a43b-e1db87b86888 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:12.427920 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4e51a445-220c-4540-a43b-e1db87b86888 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:12.437618 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4e51a445-220c-4540-a43b-e1db87b86888 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1266 microversion: 2.1 time: 0.108850 Aug 24 12:40:12.438194 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 428/851] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:12 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:12.502253 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-4ba9d108-9d68-43e2-84fa-d35e3979a8cc tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:12.503187 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-4ba9d108-9d68-43e2-84fa-d35e3979a8cc tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:12.512879 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4ba9d108-9d68-43e2-84fa-d35e3979a8cc tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:12.518366 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4ba9d108-9d68-43e2-84fa-d35e3979a8cc tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:12.519614 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4ba9d108-9d68-43e2-84fa-d35e3979a8cc tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:12.521711 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4ba9d108-9d68-43e2-84fa-d35e3979a8cc tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:12.524573 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4ba9d108-9d68-43e2-84fa-d35e3979a8cc tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:12.526926 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-4ba9d108-9d68-43e2-84fa-d35e3979a8cc tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:12.973579 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-5c90dec4-c73b-4f6e-86b8-03ffc568e949 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:12.974442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-5c90dec4-c73b-4f6e-86b8-03ffc568e949 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:12.982627 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5c90dec4-c73b-4f6e-86b8-03ffc568e949 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:12.983356 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5c90dec4-c73b-4f6e-86b8-03ffc568e949 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:12.983971 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5c90dec4-c73b-4f6e-86b8-03ffc568e949 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:12.984961 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5c90dec4-c73b-4f6e-86b8-03ffc568e949 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:12.985567 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5c90dec4-c73b-4f6e-86b8-03ffc568e949 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:12.986162 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5c90dec4-c73b-4f6e-86b8-03ffc568e949 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.131808 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-5c90dec4-c73b-4f6e-86b8-03ffc568e949 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:13.140390 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-5c90dec4-c73b-4f6e-86b8-03ffc568e949 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1199 microversion: 2.1 time: 0.170519 Aug 24 12:40:13.141400 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 429/852] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:12 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1199 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:13.199129 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-4ba9d108-9d68-43e2-84fa-d35e3979a8cc tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:13.208967 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-4ba9d108-9d68-43e2-84fa-d35e3979a8cc tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1318 microversion: 2.1 time: 0.713573 Aug 24 12:40:13.210000 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 424/853] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:12 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1318 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:13.459198 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b7767134-3f41-4b16-a37a-1fa721281fd5 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:13.460674 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b7767134-3f41-4b16-a37a-1fa721281fd5 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:13.469929 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b7767134-3f41-4b16-a37a-1fa721281fd5 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.471573 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b7767134-3f41-4b16-a37a-1fa721281fd5 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.472275 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b7767134-3f41-4b16-a37a-1fa721281fd5 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.473281 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b7767134-3f41-4b16-a37a-1fa721281fd5 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.473944 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b7767134-3f41-4b16-a37a-1fa721281fd5 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.474763 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b7767134-3f41-4b16-a37a-1fa721281fd5 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.569455 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b7767134-3f41-4b16-a37a-1fa721281fd5 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:13.582059 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b7767134-3f41-4b16-a37a-1fa721281fd5 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1272 microversion: 2.1 time: 0.126784 Aug 24 12:40:13.583114 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 430/854] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:13 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1272 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:14.165064 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0a3ec41d-47cc-4721-89f6-fe0a2fab2e17 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:14.165820 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0a3ec41d-47cc-4721-89f6-fe0a2fab2e17 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:14.178472 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0a3ec41d-47cc-4721-89f6-fe0a2fab2e17 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.178970 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0a3ec41d-47cc-4721-89f6-fe0a2fab2e17 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.179433 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0a3ec41d-47cc-4721-89f6-fe0a2fab2e17 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.184960 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0a3ec41d-47cc-4721-89f6-fe0a2fab2e17 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.188040 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0a3ec41d-47cc-4721-89f6-fe0a2fab2e17 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.188518 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0a3ec41d-47cc-4721-89f6-fe0a2fab2e17 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.231402 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d235cfe5-82d1-481f-820a-77ffb3d84556 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:14.232859 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d235cfe5-82d1-481f-820a-77ffb3d84556 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:14.240146 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d235cfe5-82d1-481f-820a-77ffb3d84556 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.240809 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d235cfe5-82d1-481f-820a-77ffb3d84556 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.241308 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d235cfe5-82d1-481f-820a-77ffb3d84556 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.242198 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d235cfe5-82d1-481f-820a-77ffb3d84556 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.244822 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d235cfe5-82d1-481f-820a-77ffb3d84556 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.244822 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d235cfe5-82d1-481f-820a-77ffb3d84556 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.685273 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-0a3ec41d-47cc-4721-89f6-fe0a2fab2e17 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:14.694672 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0a3ec41d-47cc-4721-89f6-fe0a2fab2e17 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1266 microversion: 2.1 time: 0.536154 Aug 24 12:40:14.695648 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 425/855] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:14 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1266 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:14.701958 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-b6a382d5-a2aa-43fe-8056-8e001f917426 req-b106e2d8-4c93-4e92-88bd-8e15ce315316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7", "tag": "154fd828-a0ba-4052-8d11-2881dad1d6e5"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:14.711825 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b6a382d5-a2aa-43fe-8056-8e001f917426 req-b106e2d8-4c93-4e92-88bd-8e15ce315316 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.712538 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b6a382d5-a2aa-43fe-8056-8e001f917426 req-b106e2d8-4c93-4e92-88bd-8e15ce315316 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.713129 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b6a382d5-a2aa-43fe-8056-8e001f917426 req-b106e2d8-4c93-4e92-88bd-8e15ce315316 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.725829 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-b6a382d5-a2aa-43fe-8056-8e001f917426 req-b106e2d8-4c93-4e92-88bd-8e15ce315316 service nova] Creating event network-changed:154fd828-a0ba-4052-8d11-2881dad1d6e5 for instance dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 on hv-cinder-84890 Aug 24 12:40:14.731318 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-b6a382d5-a2aa-43fe-8056-8e001f917426 req-b106e2d8-4c93-4e92-88bd-8e15ce315316 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033781 Aug 24 12:40:14.732647 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 426/856] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:14.740333 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d235cfe5-82d1-481f-820a-77ffb3d84556 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:14.749962 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d235cfe5-82d1-481f-820a-77ffb3d84556 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1318 microversion: 2.1 time: 0.523454 Aug 24 12:40:14.752577 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-0f160843-1759-4ee8-aba3-601a346a937d req-ca0be3a2-d141-4024-bf33-b5d21e174466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c606e495-b7a7-4d6e-b5a5-5ff311442a3a", "name": "network-vif-plugged", "status": "completed", "tag": "4a8e2efd-9085-42b3-aceb-2009f0c5c0ad"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:14.767826 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 431/857] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:14 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:14.775454 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-629a9b30-92fc-4916-972a-8b1dea4b8ff0 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:14.776098 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-629a9b30-92fc-4916-972a-8b1dea4b8ff0 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:14.783448 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-629a9b30-92fc-4916-972a-8b1dea4b8ff0 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.783978 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-629a9b30-92fc-4916-972a-8b1dea4b8ff0 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.784413 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-629a9b30-92fc-4916-972a-8b1dea4b8ff0 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.785113 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-629a9b30-92fc-4916-972a-8b1dea4b8ff0 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.785564 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-629a9b30-92fc-4916-972a-8b1dea4b8ff0 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.785985 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-629a9b30-92fc-4916-972a-8b1dea4b8ff0 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.798334 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-0f160843-1759-4ee8-aba3-601a346a937d req-ca0be3a2-d141-4024-bf33-b5d21e174466 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.800429 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-0f160843-1759-4ee8-aba3-601a346a937d req-ca0be3a2-d141-4024-bf33-b5d21e174466 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.801443 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-0f160843-1759-4ee8-aba3-601a346a937d req-ca0be3a2-d141-4024-bf33-b5d21e174466 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.843557 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-0f160843-1759-4ee8-aba3-601a346a937d req-ca0be3a2-d141-4024-bf33-b5d21e174466 service nova] Creating event network-vif-plugged:4a8e2efd-9085-42b3-aceb-2009f0c5c0ad for instance c606e495-b7a7-4d6e-b5a5-5ff311442a3a on hv-cinder-84890 Aug 24 12:40:14.851586 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-0f160843-1759-4ee8-aba3-601a346a937d req-ca0be3a2-d141-4024-bf33-b5d21e174466 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117342 Aug 24 12:40:14.852543 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 427/858] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:14.879950 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-dc29a5b9-b181-4cdc-af85-436b1fc2644e req-20d82b9b-b8b0-4151-9ee5-bf9c7178290f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c20576-80ad-4147-b881-ed9af3763364", "tag": "a1ab7022-6250-431e-ad5f-7f8475746b80"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:14.894373 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-dc29a5b9-b181-4cdc-af85-436b1fc2644e req-20d82b9b-b8b0-4151-9ee5-bf9c7178290f service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.906753 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-dc29a5b9-b181-4cdc-af85-436b1fc2644e req-20d82b9b-b8b0-4151-9ee5-bf9c7178290f service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.908959 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-dc29a5b9-b181-4cdc-af85-436b1fc2644e req-20d82b9b-b8b0-4151-9ee5-bf9c7178290f service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.927332 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-dc29a5b9-b181-4cdc-af85-436b1fc2644e req-20d82b9b-b8b0-4151-9ee5-bf9c7178290f service nova] Creating event network-changed:a1ab7022-6250-431e-ad5f-7f8475746b80 for instance 26c20576-80ad-4147-b881-ed9af3763364 on hv-cinder-84890 Aug 24 12:40:14.933732 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-dc29a5b9-b181-4cdc-af85-436b1fc2644e req-20d82b9b-b8b0-4151-9ee5-bf9c7178290f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060096 Aug 24 12:40:14.937058 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 428/859] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:15.072991 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-629a9b30-92fc-4916-972a-8b1dea4b8ff0 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:15.090152 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-629a9b30-92fc-4916-972a-8b1dea4b8ff0 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1314 microversion: 2.1 time: 0.320543 Aug 24 12:40:15.105378 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 432/860] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:14 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:15.719167 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8c54a621-e6d2-459e-8f00-df5ca2b74859 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:15.720078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8c54a621-e6d2-459e-8f00-df5ca2b74859 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:15.727391 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c54a621-e6d2-459e-8f00-df5ca2b74859 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:15.727925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c54a621-e6d2-459e-8f00-df5ca2b74859 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:15.728819 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c54a621-e6d2-459e-8f00-df5ca2b74859 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:15.729539 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c54a621-e6d2-459e-8f00-df5ca2b74859 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:15.730399 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c54a621-e6d2-459e-8f00-df5ca2b74859 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:15.730838 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c54a621-e6d2-459e-8f00-df5ca2b74859 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:15.778519 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c77802a5-fa49-4e9a-b968-c1a494fe2c62 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:15.779234 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c77802a5-fa49-4e9a-b968-c1a494fe2c62 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:15.787320 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c77802a5-fa49-4e9a-b968-c1a494fe2c62 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:15.787865 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c77802a5-fa49-4e9a-b968-c1a494fe2c62 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:15.788452 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c77802a5-fa49-4e9a-b968-c1a494fe2c62 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:15.789335 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c77802a5-fa49-4e9a-b968-c1a494fe2c62 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:15.789951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c77802a5-fa49-4e9a-b968-c1a494fe2c62 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:15.790793 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c77802a5-fa49-4e9a-b968-c1a494fe2c62 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:15.960694 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8c54a621-e6d2-459e-8f00-df5ca2b74859 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:15.969706 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8c54a621-e6d2-459e-8f00-df5ca2b74859 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1266 microversion: 2.1 time: 0.256864 Aug 24 12:40:15.970760 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 429/861] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:15 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:15.990122 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c77802a5-fa49-4e9a-b968-c1a494fe2c62 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:15.999270 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c77802a5-fa49-4e9a-b968-c1a494fe2c62 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1318 microversion: 2.1 time: 0.225023 Aug 24 12:40:15.999884 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 433/862] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:15 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:16.114937 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-1dae92b8-d8b0-4469-b718-4109fbcae10f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:16.115614 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-1dae92b8-d8b0-4469-b718-4109fbcae10f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:16.121580 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1dae92b8-d8b0-4469-b718-4109fbcae10f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:16.122635 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1dae92b8-d8b0-4469-b718-4109fbcae10f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:16.123087 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1dae92b8-d8b0-4469-b718-4109fbcae10f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:16.123811 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1dae92b8-d8b0-4469-b718-4109fbcae10f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:16.124272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1dae92b8-d8b0-4469-b718-4109fbcae10f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:16.124817 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1dae92b8-d8b0-4469-b718-4109fbcae10f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:16.270556 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-1dae92b8-d8b0-4469-b718-4109fbcae10f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:16.278282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-1dae92b8-d8b0-4469-b718-4109fbcae10f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1314 microversion: 2.1 time: 0.167733 Aug 24 12:40:16.278836 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 430/863] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:16 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:16.990547 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-897d62a9-c241-41a7-945a-95325cdb68f9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:16.991184 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-897d62a9-c241-41a7-945a-95325cdb68f9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:17.000011 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-897d62a9-c241-41a7-945a-95325cdb68f9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:17.000693 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-897d62a9-c241-41a7-945a-95325cdb68f9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:17.001164 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-897d62a9-c241-41a7-945a-95325cdb68f9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:17.001859 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-897d62a9-c241-41a7-945a-95325cdb68f9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:17.002313 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-897d62a9-c241-41a7-945a-95325cdb68f9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:17.002733 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-897d62a9-c241-41a7-945a-95325cdb68f9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:17.019898 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-dbb4c659-933c-4273-8c9a-29f83fdfd8d0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:17.020515 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-dbb4c659-933c-4273-8c9a-29f83fdfd8d0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:17.027306 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dbb4c659-933c-4273-8c9a-29f83fdfd8d0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:17.027830 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dbb4c659-933c-4273-8c9a-29f83fdfd8d0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:17.028493 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dbb4c659-933c-4273-8c9a-29f83fdfd8d0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:17.029202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dbb4c659-933c-4273-8c9a-29f83fdfd8d0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:17.029655 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dbb4c659-933c-4273-8c9a-29f83fdfd8d0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:17.030076 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-dbb4c659-933c-4273-8c9a-29f83fdfd8d0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:17.204832 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-897d62a9-c241-41a7-945a-95325cdb68f9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:17.211845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-dbb4c659-933c-4273-8c9a-29f83fdfd8d0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:17.213257 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-897d62a9-c241-41a7-945a-95325cdb68f9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1266 microversion: 2.1 time: 0.226590 Aug 24 12:40:17.214253 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 434/864] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:16 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:17.220412 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-dbb4c659-933c-4273-8c9a-29f83fdfd8d0 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1318 microversion: 2.1 time: 0.204477 Aug 24 12:40:17.221037 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 431/865] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:17 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:17.301595 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e4f74ba8-7641-4a4d-abff-136ce59cad1e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:17.303147 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e4f74ba8-7641-4a4d-abff-136ce59cad1e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:17.310680 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e4f74ba8-7641-4a4d-abff-136ce59cad1e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:17.311169 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e4f74ba8-7641-4a4d-abff-136ce59cad1e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:17.311607 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e4f74ba8-7641-4a4d-abff-136ce59cad1e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:17.312322 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e4f74ba8-7641-4a4d-abff-136ce59cad1e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:17.312769 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e4f74ba8-7641-4a4d-abff-136ce59cad1e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:17.313198 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e4f74ba8-7641-4a4d-abff-136ce59cad1e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:17.445627 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e4f74ba8-7641-4a4d-abff-136ce59cad1e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:17.453706 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e4f74ba8-7641-4a4d-abff-136ce59cad1e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1314 microversion: 2.1 time: 0.156779 Aug 24 12:40:17.454253 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 435/866] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:17 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:18.233838 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d4ef8b6d-34f9-47d1-9a22-e59627eb1e55 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:18.234386 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d4ef8b6d-34f9-47d1-9a22-e59627eb1e55 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:18.240255 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e29b15c7-ebfd-4d98-8027-4658c577744e tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:18.240866 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e29b15c7-ebfd-4d98-8027-4658c577744e tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:18.241021 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4ef8b6d-34f9-47d1-9a22-e59627eb1e55 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:18.241502 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4ef8b6d-34f9-47d1-9a22-e59627eb1e55 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:18.241964 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4ef8b6d-34f9-47d1-9a22-e59627eb1e55 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:18.242651 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4ef8b6d-34f9-47d1-9a22-e59627eb1e55 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:18.243101 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4ef8b6d-34f9-47d1-9a22-e59627eb1e55 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:18.243520 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d4ef8b6d-34f9-47d1-9a22-e59627eb1e55 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:18.247705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e29b15c7-ebfd-4d98-8027-4658c577744e tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:18.248282 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e29b15c7-ebfd-4d98-8027-4658c577744e tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:18.248716 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e29b15c7-ebfd-4d98-8027-4658c577744e tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:18.249401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e29b15c7-ebfd-4d98-8027-4658c577744e tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:18.249854 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e29b15c7-ebfd-4d98-8027-4658c577744e tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:18.250272 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e29b15c7-ebfd-4d98-8027-4658c577744e tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:18.686973 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-d4ef8b6d-34f9-47d1-9a22-e59627eb1e55 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:18.691083 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e29b15c7-ebfd-4d98-8027-4658c577744e tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:18.695063 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d4ef8b6d-34f9-47d1-9a22-e59627eb1e55 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1266 microversion: 2.1 time: 0.465307 Aug 24 12:40:18.695923 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 432/867] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:18 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1266 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:18.700303 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e29b15c7-ebfd-4d98-8027-4658c577744e tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1318 microversion: 2.1 time: 0.463382 Aug 24 12:40:18.700874 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-75da3972-1dcd-4264-baff-6f9fab2e28b7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:18.701483 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-75da3972-1dcd-4264-baff-6f9fab2e28b7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:18.701910 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 436/868] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:18 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:18.707545 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-75da3972-1dcd-4264-baff-6f9fab2e28b7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:18.708315 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-75da3972-1dcd-4264-baff-6f9fab2e28b7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:18.708962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-75da3972-1dcd-4264-baff-6f9fab2e28b7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:18.709891 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-75da3972-1dcd-4264-baff-6f9fab2e28b7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:18.710568 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-75da3972-1dcd-4264-baff-6f9fab2e28b7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:18.711311 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-75da3972-1dcd-4264-baff-6f9fab2e28b7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:18.853942 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-75da3972-1dcd-4264-baff-6f9fab2e28b7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:18.863176 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-75da3972-1dcd-4264-baff-6f9fab2e28b7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1314 microversion: 2.1 time: 0.166195 Aug 24 12:40:18.863881 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 433/869] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:18 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:19.715955 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-be92d6a1-0f8b-4da5-81dd-c53c5c06f2ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:19.716563 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-be92d6a1-0f8b-4da5-81dd-c53c5c06f2ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:19.721456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-beac6e6f-5592-44b4-aa07-3a5521b0af67 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:19.722067 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-beac6e6f-5592-44b4-aa07-3a5521b0af67 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:19.723243 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be92d6a1-0f8b-4da5-81dd-c53c5c06f2ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:19.723761 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be92d6a1-0f8b-4da5-81dd-c53c5c06f2ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:19.724203 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be92d6a1-0f8b-4da5-81dd-c53c5c06f2ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:19.724925 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be92d6a1-0f8b-4da5-81dd-c53c5c06f2ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:19.725378 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be92d6a1-0f8b-4da5-81dd-c53c5c06f2ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:19.725799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-be92d6a1-0f8b-4da5-81dd-c53c5c06f2ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:19.728582 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-beac6e6f-5592-44b4-aa07-3a5521b0af67 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:19.729067 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-beac6e6f-5592-44b4-aa07-3a5521b0af67 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:19.729497 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-beac6e6f-5592-44b4-aa07-3a5521b0af67 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:19.730360 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-beac6e6f-5592-44b4-aa07-3a5521b0af67 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:19.730907 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-beac6e6f-5592-44b4-aa07-3a5521b0af67 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:19.731531 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-beac6e6f-5592-44b4-aa07-3a5521b0af67 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:19.921568 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-be92d6a1-0f8b-4da5-81dd-c53c5c06f2ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:19.929997 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-beac6e6f-5592-44b4-aa07-3a5521b0af67 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:19.930994 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-be92d6a1-0f8b-4da5-81dd-c53c5c06f2ea tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1266 microversion: 2.1 time: 0.218869 Aug 24 12:40:19.943979 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 437/870] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:19 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:19.943979 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b7548fa9-6fdf-4dd7-b322-fbe17ada8985 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:19.943979 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b7548fa9-6fdf-4dd7-b322-fbe17ada8985 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:19.943979 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b7548fa9-6fdf-4dd7-b322-fbe17ada8985 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:19.943979 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b7548fa9-6fdf-4dd7-b322-fbe17ada8985 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:19.944564 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b7548fa9-6fdf-4dd7-b322-fbe17ada8985 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:19.944704 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b7548fa9-6fdf-4dd7-b322-fbe17ada8985 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:19.945677 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b7548fa9-6fdf-4dd7-b322-fbe17ada8985 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:19.945677 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b7548fa9-6fdf-4dd7-b322-fbe17ada8985 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:19.954065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-beac6e6f-5592-44b4-aa07-3a5521b0af67 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1318 microversion: 2.1 time: 0.236513 Aug 24 12:40:19.954886 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 434/871] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:19 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:20.102085 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b7548fa9-6fdf-4dd7-b322-fbe17ada8985 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:20.110227 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b7548fa9-6fdf-4dd7-b322-fbe17ada8985 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1314 microversion: 2.1 time: 0.177683 Aug 24 12:40:20.110801 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 438/872] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:19 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:20.953675 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6b9088bb-6340-4512-8569-02b34c331c6c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:20.954204 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-6b9088bb-6340-4512-8569-02b34c331c6c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:20.956157 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=4 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:20.961681 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6b9088bb-6340-4512-8569-02b34c331c6c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:20.962164 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6b9088bb-6340-4512-8569-02b34c331c6c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:20.962601 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6b9088bb-6340-4512-8569-02b34c331c6c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:20.963291 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6b9088bb-6340-4512-8569-02b34c331c6c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:20.963776 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6b9088bb-6340-4512-8569-02b34c331c6c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:20.964202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6b9088bb-6340-4512-8569-02b34c331c6c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:20.974477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d9d3cab2-6cc2-4bff-a68c-be5905aeac9b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:20.975080 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d9d3cab2-6cc2-4bff-a68c-be5905aeac9b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:20.982318 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d9d3cab2-6cc2-4bff-a68c-be5905aeac9b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:20.982865 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d9d3cab2-6cc2-4bff-a68c-be5905aeac9b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:20.983295 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d9d3cab2-6cc2-4bff-a68c-be5905aeac9b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:20.984016 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d9d3cab2-6cc2-4bff-a68c-be5905aeac9b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:20.984465 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d9d3cab2-6cc2-4bff-a68c-be5905aeac9b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:20.984877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d9d3cab2-6cc2-4bff-a68c-be5905aeac9b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:20.989018 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=100 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:21.002573 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:21.023577 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=8 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:21.158046 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6b9088bb-6340-4512-8569-02b34c331c6c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:21.165665 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-6b9088bb-6340-4512-8569-02b34c331c6c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1266 microversion: 2.1 time: 0.216306 Aug 24 12:40:21.166246 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 435/873] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:20 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:21.171226 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8349503b-206b-479e-b10f-7947296875c7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:21.172105 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8349503b-206b-479e-b10f-7947296875c7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:21.178957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d9d3cab2-6cc2-4bff-a68c-be5905aeac9b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:21.182683 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8349503b-206b-479e-b10f-7947296875c7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:21.183184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8349503b-206b-479e-b10f-7947296875c7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:21.183650 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8349503b-206b-479e-b10f-7947296875c7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:21.184388 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8349503b-206b-479e-b10f-7947296875c7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:21.184841 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8349503b-206b-479e-b10f-7947296875c7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:21.185266 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8349503b-206b-479e-b10f-7947296875c7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:21.186607 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d9d3cab2-6cc2-4bff-a68c-be5905aeac9b tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1508 microversion: 2.1 time: 0.215934 Aug 24 12:40:21.187172 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 439/874] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:20 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:21.207128 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4d16ba68-073d-49f8-8d26-bb94d1fc2563 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d01cc85-8bdf-47ae-955d-f93e4677c632", "device": "/dev/sdb"}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:21.211316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4d16ba68-073d-49f8-8d26-bb94d1fc2563 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:21.218512 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4d16ba68-073d-49f8-8d26-bb94d1fc2563 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:21.219006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4d16ba68-073d-49f8-8d26-bb94d1fc2563 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:21.219446 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4d16ba68-073d-49f8-8d26-bb94d1fc2563 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:21.220174 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4d16ba68-073d-49f8-8d26-bb94d1fc2563 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:21.220632 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4d16ba68-073d-49f8-8d26-bb94d1fc2563 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:21.221059 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4d16ba68-073d-49f8-8d26-bb94d1fc2563 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:21.303946 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=16 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:21.318429 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8349503b-206b-479e-b10f-7947296875c7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:21.326237 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8349503b-206b-479e-b10f-7947296875c7 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1314 microversion: 2.1 time: 0.159036 Aug 24 12:40:21.326783 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 436/875] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:21 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:22.189274 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-286ef84e-be05-4105-a267-f96b8b207cbb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:22.189951 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-286ef84e-be05-4105-a267-f96b8b207cbb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:22.196250 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-286ef84e-be05-4105-a267-f96b8b207cbb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:22.196736 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-286ef84e-be05-4105-a267-f96b8b207cbb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:22.197209 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-286ef84e-be05-4105-a267-f96b8b207cbb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:22.197909 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-286ef84e-be05-4105-a267-f96b8b207cbb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:22.198367 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-286ef84e-be05-4105-a267-f96b8b207cbb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:22.198794 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-286ef84e-be05-4105-a267-f96b8b207cbb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:22.333102 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-286ef84e-be05-4105-a267-f96b8b207cbb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:22.340670 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-286ef84e-be05-4105-a267-f96b8b207cbb tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1266 microversion: 2.1 time: 0.155897 Aug 24 12:40:22.341223 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 437/876] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:22 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:22.348476 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-93ec5416-73c2-4e1a-aea7-5b4a8ba3f1b2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:22.349151 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-93ec5416-73c2-4e1a-aea7-5b4a8ba3f1b2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:22.355080 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-93ec5416-73c2-4e1a-aea7-5b4a8ba3f1b2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:22.355562 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-93ec5416-73c2-4e1a-aea7-5b4a8ba3f1b2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:22.356026 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-93ec5416-73c2-4e1a-aea7-5b4a8ba3f1b2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:22.356881 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-93ec5416-73c2-4e1a-aea7-5b4a8ba3f1b2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:22.357411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-93ec5416-73c2-4e1a-aea7-5b4a8ba3f1b2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:22.357832 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-93ec5416-73c2-4e1a-aea7-5b4a8ba3f1b2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:22.378493 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=100 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:22.487162 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-93ec5416-73c2-4e1a-aea7-5b4a8ba3f1b2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:22.494723 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-93ec5416-73c2-4e1a-aea7-5b4a8ba3f1b2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1314 microversion: 2.1 time: 0.152209 Aug 24 12:40:22.495279 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 438/877] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:22 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:23.361952 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-fc7e7697-c95d-4546-835a-662aef6d75bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:23.362578 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-fc7e7697-c95d-4546-835a-662aef6d75bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:23.369103 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc7e7697-c95d-4546-835a-662aef6d75bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:23.369632 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc7e7697-c95d-4546-835a-662aef6d75bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:23.370074 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc7e7697-c95d-4546-835a-662aef6d75bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:23.370772 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc7e7697-c95d-4546-835a-662aef6d75bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:23.371234 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc7e7697-c95d-4546-835a-662aef6d75bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:23.371728 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc7e7697-c95d-4546-835a-662aef6d75bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:23.504492 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-fc7e7697-c95d-4546-835a-662aef6d75bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:23.512182 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-fc7e7697-c95d-4546-835a-662aef6d75bd tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1266 microversion: 2.1 time: 0.154171 Aug 24 12:40:23.512742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 439/878] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:23 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:23.517796 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-7f053850-11ab-438e-8f40-88b8fc120b4f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:23.518399 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-7f053850-11ab-438e-8f40-88b8fc120b4f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:23.523943 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f053850-11ab-438e-8f40-88b8fc120b4f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:23.524414 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f053850-11ab-438e-8f40-88b8fc120b4f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:23.524850 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f053850-11ab-438e-8f40-88b8fc120b4f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:23.525533 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f053850-11ab-438e-8f40-88b8fc120b4f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:23.525984 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f053850-11ab-438e-8f40-88b8fc120b4f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:23.526433 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7f053850-11ab-438e-8f40-88b8fc120b4f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:23.651609 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7f053850-11ab-438e-8f40-88b8fc120b4f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:23.659591 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-7f053850-11ab-438e-8f40-88b8fc120b4f tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1314 microversion: 2.1 time: 0.145238 Aug 24 12:40:23.660182 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 440/879] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:23 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:23.836293 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-b4bc4f81-10e4-48eb-8d36-b2060f7fe584 req-a3b22d0b-604e-4fe0-9f95-0055d256adab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c20576-80ad-4147-b881-ed9af3763364", "name": "network-vif-plugged", "status": "completed", "tag": "a1ab7022-6250-431e-ad5f-7f8475746b80"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:23.845795 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b4bc4f81-10e4-48eb-8d36-b2060f7fe584 req-a3b22d0b-604e-4fe0-9f95-0055d256adab service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:23.846310 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b4bc4f81-10e4-48eb-8d36-b2060f7fe584 req-a3b22d0b-604e-4fe0-9f95-0055d256adab service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:23.846715 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b4bc4f81-10e4-48eb-8d36-b2060f7fe584 req-a3b22d0b-604e-4fe0-9f95-0055d256adab service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:23.858697 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-b4bc4f81-10e4-48eb-8d36-b2060f7fe584 req-a3b22d0b-604e-4fe0-9f95-0055d256adab service nova] Creating event network-vif-plugged:a1ab7022-6250-431e-ad5f-7f8475746b80 for instance 26c20576-80ad-4147-b881-ed9af3763364 on hv-cinder-84890 Aug 24 12:40:23.863664 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-b4bc4f81-10e4-48eb-8d36-b2060f7fe584 req-a3b22d0b-604e-4fe0-9f95-0055d256adab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031078 Aug 24 12:40:23.864249 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 441/880] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:40:24.214036 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4d16ba68-073d-49f8-8d26-bb94d1fc2563 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "POST /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.010849 Aug 24 12:40:24.215688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 440/881] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 12:40:21 2022] POST /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a/os-volume_attachments => generated 194 bytes in 3013 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:40:24.534764 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5002b5da-1e1e-4221-a63d-059a93305835 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:24.535469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5002b5da-1e1e-4221-a63d-059a93305835 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:24.541470 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5002b5da-1e1e-4221-a63d-059a93305835 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:24.541961 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5002b5da-1e1e-4221-a63d-059a93305835 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:24.542401 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5002b5da-1e1e-4221-a63d-059a93305835 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:24.543092 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5002b5da-1e1e-4221-a63d-059a93305835 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:24.543545 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5002b5da-1e1e-4221-a63d-059a93305835 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:24.544180 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5002b5da-1e1e-4221-a63d-059a93305835 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:24.682416 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d0a071e5-1688-4cb6-a287-3ef0aae46b41 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:24.683145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d0a071e5-1688-4cb6-a287-3ef0aae46b41 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:24.684931 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5002b5da-1e1e-4221-a63d-059a93305835 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:24.690669 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d0a071e5-1688-4cb6-a287-3ef0aae46b41 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:24.691237 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d0a071e5-1688-4cb6-a287-3ef0aae46b41 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:24.691689 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d0a071e5-1688-4cb6-a287-3ef0aae46b41 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:24.692381 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d0a071e5-1688-4cb6-a287-3ef0aae46b41 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:24.692829 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d0a071e5-1688-4cb6-a287-3ef0aae46b41 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:24.693249 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d0a071e5-1688-4cb6-a287-3ef0aae46b41 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:24.693401 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5002b5da-1e1e-4221-a63d-059a93305835 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1266 microversion: 2.1 time: 0.163224 Aug 24 12:40:24.693915 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 442/882] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:24 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:24.833055 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d0a071e5-1688-4cb6-a287-3ef0aae46b41 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:24.841360 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d0a071e5-1688-4cb6-a287-3ef0aae46b41 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1314 microversion: 2.1 time: 0.163734 Aug 24 12:40:24.842284 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 441/883] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:24 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:25.718514 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-827d1054-e4b5-47b5-947c-1dea6fe6b9ad tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:25.719388 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-827d1054-e4b5-47b5-947c-1dea6fe6b9ad tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:25.726153 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-827d1054-e4b5-47b5-947c-1dea6fe6b9ad tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:25.726647 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-827d1054-e4b5-47b5-947c-1dea6fe6b9ad tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:25.727087 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-827d1054-e4b5-47b5-947c-1dea6fe6b9ad tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:25.727986 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-827d1054-e4b5-47b5-947c-1dea6fe6b9ad tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:25.728446 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-827d1054-e4b5-47b5-947c-1dea6fe6b9ad tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:25.728896 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-827d1054-e4b5-47b5-947c-1dea6fe6b9ad tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:25.863131 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-8620a6c3-94bb-4d51-b8b4-1a15cca5a4a9 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:25.864652 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-8620a6c3-94bb-4d51-b8b4-1a15cca5a4a9 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:25.872497 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8620a6c3-94bb-4d51-b8b4-1a15cca5a4a9 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:25.873374 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8620a6c3-94bb-4d51-b8b4-1a15cca5a4a9 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:25.875377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8620a6c3-94bb-4d51-b8b4-1a15cca5a4a9 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:25.876409 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8620a6c3-94bb-4d51-b8b4-1a15cca5a4a9 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:25.877049 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8620a6c3-94bb-4d51-b8b4-1a15cca5a4a9 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:25.877622 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8620a6c3-94bb-4d51-b8b4-1a15cca5a4a9 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:25.898720 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-827d1054-e4b5-47b5-947c-1dea6fe6b9ad tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:25.907606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-827d1054-e4b5-47b5-947c-1dea6fe6b9ad tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1266 microversion: 2.1 time: 0.193733 Aug 24 12:40:25.908236 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 443/884] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:25 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:26.075033 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-8620a6c3-94bb-4d51-b8b4-1a15cca5a4a9 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:26.085121 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-8620a6c3-94bb-4d51-b8b4-1a15cca5a4a9 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1498 microversion: 2.1 time: 0.225617 Aug 24 12:40:26.100124 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 442/885] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:25 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1498 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:26.231201 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-60c60755-7ea9-492b-9e93-1107b6ef25d9 req-d02732bb-95e6-4cad-8b4d-069b00cbb5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7", "name": "network-vif-plugged", "status": "completed", "tag": "154fd828-a0ba-4052-8d11-2881dad1d6e5"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:26.244787 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-60c60755-7ea9-492b-9e93-1107b6ef25d9 req-d02732bb-95e6-4cad-8b4d-069b00cbb5e6 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.245280 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-60c60755-7ea9-492b-9e93-1107b6ef25d9 req-d02732bb-95e6-4cad-8b4d-069b00cbb5e6 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.245818 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-60c60755-7ea9-492b-9e93-1107b6ef25d9 req-d02732bb-95e6-4cad-8b4d-069b00cbb5e6 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.261603 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-60c60755-7ea9-492b-9e93-1107b6ef25d9 req-d02732bb-95e6-4cad-8b4d-069b00cbb5e6 service nova] Creating event network-vif-plugged:154fd828-a0ba-4052-8d11-2881dad1d6e5 for instance dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 on hv-cinder-84890 Aug 24 12:40:26.268506 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-60c60755-7ea9-492b-9e93-1107b6ef25d9 req-d02732bb-95e6-4cad-8b4d-069b00cbb5e6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041289 Aug 24 12:40:26.269560 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 444/886] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:26.538896 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-272db0f4-24f8-42ae-8f11-3d7cfc76b575 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:26.539209 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-272db0f4-24f8-42ae-8f11-3d7cfc76b575 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:26.545650 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-272db0f4-24f8-42ae-8f11-3d7cfc76b575 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.546129 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-272db0f4-24f8-42ae-8f11-3d7cfc76b575 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.547723 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-272db0f4-24f8-42ae-8f11-3d7cfc76b575 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.548425 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-272db0f4-24f8-42ae-8f11-3d7cfc76b575 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.548876 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-272db0f4-24f8-42ae-8f11-3d7cfc76b575 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.549294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-272db0f4-24f8-42ae-8f11-3d7cfc76b575 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.580821 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-272db0f4-24f8-42ae-8f11-3d7cfc76b575 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Going to try to terminate instance {{(pid=127308) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:40:26.844115 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-272db0f4-24f8-42ae-8f11-3d7cfc76b575 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "DELETE /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 204 len: 0 microversion: 2.1 time: 0.308000 Aug 24 12:40:26.845243 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 443/887] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:40:26 2022] DELETE /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:40:26.854503 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6b043f5a-f8f6-4d99-9690-d7195bc9ff71 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:26.855418 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-6b043f5a-f8f6-4d99-9690-d7195bc9ff71 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:26.863278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6b043f5a-f8f6-4d99-9690-d7195bc9ff71 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.863816 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6b043f5a-f8f6-4d99-9690-d7195bc9ff71 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.864375 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6b043f5a-f8f6-4d99-9690-d7195bc9ff71 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.865090 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6b043f5a-f8f6-4d99-9690-d7195bc9ff71 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.865546 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6b043f5a-f8f6-4d99-9690-d7195bc9ff71 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.865968 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6b043f5a-f8f6-4d99-9690-d7195bc9ff71 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.933490 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-6561baf4-2a3c-4943-ac7d-c9e362547b0d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:26.935689 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-6561baf4-2a3c-4943-ac7d-c9e362547b0d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:26.946466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6561baf4-2a3c-4943-ac7d-c9e362547b0d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.946466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6561baf4-2a3c-4943-ac7d-c9e362547b0d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.946466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6561baf4-2a3c-4943-ac7d-c9e362547b0d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.946466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6561baf4-2a3c-4943-ac7d-c9e362547b0d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.946843 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6561baf4-2a3c-4943-ac7d-c9e362547b0d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.948973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6561baf4-2a3c-4943-ac7d-c9e362547b0d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:27.050944 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6b043f5a-f8f6-4d99-9690-d7195bc9ff71 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:27.057350 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-6b043f5a-f8f6-4d99-9690-d7195bc9ff71 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1504 microversion: 2.1 time: 0.207592 Aug 24 12:40:27.059666 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 445/888] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:26 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:27.118896 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6561baf4-2a3c-4943-ac7d-c9e362547b0d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:27.127266 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-6561baf4-2a3c-4943-ac7d-c9e362547b0d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1266 microversion: 2.1 time: 0.199466 Aug 24 12:40:27.127838 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 444/889] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:26 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:28.078496 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-51d9bcb0-02cd-46e3-b4c6-af134939eefe tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:28.079106 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-51d9bcb0-02cd-46e3-b4c6-af134939eefe tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:28.089110 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-51d9bcb0-02cd-46e3-b4c6-af134939eefe tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:28.089612 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-51d9bcb0-02cd-46e3-b4c6-af134939eefe tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:28.090057 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-51d9bcb0-02cd-46e3-b4c6-af134939eefe tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:28.090766 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-51d9bcb0-02cd-46e3-b4c6-af134939eefe tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:28.091769 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-51d9bcb0-02cd-46e3-b4c6-af134939eefe tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:28.092227 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-51d9bcb0-02cd-46e3-b4c6-af134939eefe tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:28.149817 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-51f22c23-f494-4a29-8da7-f9a37643d95d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:28.150524 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-51f22c23-f494-4a29-8da7-f9a37643d95d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:28.158433 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-51f22c23-f494-4a29-8da7-f9a37643d95d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:28.159216 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-51f22c23-f494-4a29-8da7-f9a37643d95d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:28.159637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-51f22c23-f494-4a29-8da7-f9a37643d95d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:28.160893 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-51f22c23-f494-4a29-8da7-f9a37643d95d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:28.161047 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-51f22c23-f494-4a29-8da7-f9a37643d95d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:28.161560 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-51f22c23-f494-4a29-8da7-f9a37643d95d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:28.268890 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-51d9bcb0-02cd-46e3-b4c6-af134939eefe tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:28.277151 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-51d9bcb0-02cd-46e3-b4c6-af134939eefe tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1504 microversion: 2.1 time: 0.202775 Aug 24 12:40:28.278369 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 446/890] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:28 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:28.323575 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-51f22c23-f494-4a29-8da7-f9a37643d95d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:28.334204 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-51f22c23-f494-4a29-8da7-f9a37643d95d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1266 microversion: 2.1 time: 0.187458 Aug 24 12:40:28.334204 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 445/891] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:28 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:29.300407 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9d7f2e86-24cb-41a2-acee-1698bd7166f1 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:29.301207 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-9d7f2e86-24cb-41a2-acee-1698bd7166f1 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:29.308274 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9d7f2e86-24cb-41a2-acee-1698bd7166f1 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:29.308786 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9d7f2e86-24cb-41a2-acee-1698bd7166f1 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:29.309225 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9d7f2e86-24cb-41a2-acee-1698bd7166f1 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:29.310487 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9d7f2e86-24cb-41a2-acee-1698bd7166f1 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:29.310938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9d7f2e86-24cb-41a2-acee-1698bd7166f1 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:29.311410 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9d7f2e86-24cb-41a2-acee-1698bd7166f1 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:29.353207 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-3a6d706e-5cf5-4b4c-8ec2-579b76871646 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:29.353854 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-3a6d706e-5cf5-4b4c-8ec2-579b76871646 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:29.360336 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3a6d706e-5cf5-4b4c-8ec2-579b76871646 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:29.360823 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3a6d706e-5cf5-4b4c-8ec2-579b76871646 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:29.361268 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3a6d706e-5cf5-4b4c-8ec2-579b76871646 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:29.361965 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3a6d706e-5cf5-4b4c-8ec2-579b76871646 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:29.362600 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3a6d706e-5cf5-4b4c-8ec2-579b76871646 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:29.363029 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-3a6d706e-5cf5-4b4c-8ec2-579b76871646 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:29.488936 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-9d7f2e86-24cb-41a2-acee-1698bd7166f1 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:29.496514 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9d7f2e86-24cb-41a2-acee-1698bd7166f1 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1504 microversion: 2.1 time: 0.201181 Aug 24 12:40:29.497079 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 447/892] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:29 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:29.523948 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-3a6d706e-5cf5-4b4c-8ec2-579b76871646 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:29.532613 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-3a6d706e-5cf5-4b4c-8ec2-579b76871646 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1266 microversion: 2.1 time: 0.183270 Aug 24 12:40:29.533170 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 446/893] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:29 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:30.521869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-1efde699-fb5a-4e6e-9b2d-e9ce7a7df17a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:30.523229 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-1efde699-fb5a-4e6e-9b2d-e9ce7a7df17a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:30.527707 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:30.533118 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1efde699-fb5a-4e6e-9b2d-e9ce7a7df17a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:30.533622 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1efde699-fb5a-4e6e-9b2d-e9ce7a7df17a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:30.534347 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1efde699-fb5a-4e6e-9b2d-e9ce7a7df17a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:30.535640 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1efde699-fb5a-4e6e-9b2d-e9ce7a7df17a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:30.536137 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1efde699-fb5a-4e6e-9b2d-e9ce7a7df17a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:30.536566 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1efde699-fb5a-4e6e-9b2d-e9ce7a7df17a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:30.552830 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a3af20d0-5634-4cf2-aeb0-95cf29001bb1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:30.553429 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-a3af20d0-5634-4cf2-aeb0-95cf29001bb1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:30.560066 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a3af20d0-5634-4cf2-aeb0-95cf29001bb1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:30.560551 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a3af20d0-5634-4cf2-aeb0-95cf29001bb1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:30.560984 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a3af20d0-5634-4cf2-aeb0-95cf29001bb1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:30.562299 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a3af20d0-5634-4cf2-aeb0-95cf29001bb1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:30.562759 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a3af20d0-5634-4cf2-aeb0-95cf29001bb1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:30.563583 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a3af20d0-5634-4cf2-aeb0-95cf29001bb1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:30.742164 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-1efde699-fb5a-4e6e-9b2d-e9ce7a7df17a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:30.745711 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-a3af20d0-5634-4cf2-aeb0-95cf29001bb1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:30.751887 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-1efde699-fb5a-4e6e-9b2d-e9ce7a7df17a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1504 microversion: 2.1 time: 0.236712 Aug 24 12:40:30.752465 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 448/894] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:30 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:30.765866 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a3af20d0-5634-4cf2-aeb0-95cf29001bb1 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1266 microversion: 2.1 time: 0.205465 Aug 24 12:40:30.765866 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 447/895] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:30 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:31.774561 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-48062624-8939-4735-8dae-4d816c247aec tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:31.775179 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-48062624-8939-4735-8dae-4d816c247aec tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:31.777041 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f34f14b8-abf6-411e-af0a-a6ae4600361e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:31.778213 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f34f14b8-abf6-411e-af0a-a6ae4600361e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:31.782759 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-48062624-8939-4735-8dae-4d816c247aec tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:31.783456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-48062624-8939-4735-8dae-4d816c247aec tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:31.784367 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-48062624-8939-4735-8dae-4d816c247aec tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:31.785918 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-48062624-8939-4735-8dae-4d816c247aec tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:31.787190 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-48062624-8939-4735-8dae-4d816c247aec tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:31.787655 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-48062624-8939-4735-8dae-4d816c247aec tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:31.788638 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f34f14b8-abf6-411e-af0a-a6ae4600361e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:31.789230 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f34f14b8-abf6-411e-af0a-a6ae4600361e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:31.790101 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f34f14b8-abf6-411e-af0a-a6ae4600361e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:31.791196 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f34f14b8-abf6-411e-af0a-a6ae4600361e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:31.791894 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f34f14b8-abf6-411e-af0a-a6ae4600361e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:31.792418 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f34f14b8-abf6-411e-af0a-a6ae4600361e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:31.894361 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-48062624-8939-4735-8dae-4d816c247aec tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:31.904962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-48062624-8939-4735-8dae-4d816c247aec tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1462 microversion: 2.1 time: 0.134054 Aug 24 12:40:31.905878 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 449/896] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:31 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1462 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:31.910930 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-b3c3a167-05ab-4252-906f-27feff72cf7a req-dbd41693-4b8e-44ee-8ec5-7cd7764cbe5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c20576-80ad-4147-b881-ed9af3763364", "name": "network-vif-deleted", "tag": "a1ab7022-6250-431e-ad5f-7f8475746b80"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:31.923061 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b3c3a167-05ab-4252-906f-27feff72cf7a req-dbd41693-4b8e-44ee-8ec5-7cd7764cbe5c service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:31.923709 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b3c3a167-05ab-4252-906f-27feff72cf7a req-dbd41693-4b8e-44ee-8ec5-7cd7764cbe5c service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:31.924237 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b3c3a167-05ab-4252-906f-27feff72cf7a req-dbd41693-4b8e-44ee-8ec5-7cd7764cbe5c service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:31.936139 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-b3c3a167-05ab-4252-906f-27feff72cf7a req-dbd41693-4b8e-44ee-8ec5-7cd7764cbe5c service nova] Creating event network-vif-deleted:a1ab7022-6250-431e-ad5f-7f8475746b80 for instance 26c20576-80ad-4147-b881-ed9af3763364 on hv-cinder-84890 Aug 24 12:40:31.941286 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-b3c3a167-05ab-4252-906f-27feff72cf7a req-dbd41693-4b8e-44ee-8ec5-7cd7764cbe5c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033623 Aug 24 12:40:31.941897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 450/897] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:31.961434 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f34f14b8-abf6-411e-af0a-a6ae4600361e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:31.969193 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f34f14b8-abf6-411e-af0a-a6ae4600361e tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1453 microversion: 2.1 time: 0.198184 Aug 24 12:40:31.969744 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 448/898] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:31 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:31.990927 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d05765dd-128e-44fb-892a-f0f360c5b328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:31.991648 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d05765dd-128e-44fb-892a-f0f360c5b328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:31.998493 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d05765dd-128e-44fb-892a-f0f360c5b328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:31.998981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d05765dd-128e-44fb-892a-f0f360c5b328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:31.999422 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d05765dd-128e-44fb-892a-f0f360c5b328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:32.000146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d05765dd-128e-44fb-892a-f0f360c5b328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:32.000600 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d05765dd-128e-44fb-892a-f0f360c5b328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:32.001026 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d05765dd-128e-44fb-892a-f0f360c5b328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:32.141080 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-d05765dd-128e-44fb-892a-f0f360c5b328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:32.148848 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d05765dd-128e-44fb-892a-f0f360c5b328 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1453 microversion: 2.1 time: 0.162762 Aug 24 12:40:32.149403 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 451/899] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:31 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:32.926624 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-57c0a71a-2811-406c-bc5e-fbc5350730d2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:32.927938 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-57c0a71a-2811-406c-bc5e-fbc5350730d2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:32.930399 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:32.936456 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-57c0a71a-2811-406c-bc5e-fbc5350730d2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:32.936955 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-57c0a71a-2811-406c-bc5e-fbc5350730d2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:32.937385 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-57c0a71a-2811-406c-bc5e-fbc5350730d2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:32.938302 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-57c0a71a-2811-406c-bc5e-fbc5350730d2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:32.939433 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-57c0a71a-2811-406c-bc5e-fbc5350730d2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:32.939881 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-57c0a71a-2811-406c-bc5e-fbc5350730d2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:32.986281 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-57c0a71a-2811-406c-bc5e-fbc5350730d2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:32.987041 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-57c0a71a-2811-406c-bc5e-fbc5350730d2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:32.987449 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-57c0a71a-2811-406c-bc5e-fbc5350730d2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:32.987986 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-57c0a71a-2811-406c-bc5e-fbc5350730d2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lazy-loading 'fault' on Instance uuid 26c20576-80ad-4147-b881-ed9af3763364 {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:40:33.036071 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-57c0a71a-2811-406c-bc5e-fbc5350730d2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:33.044784 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-57c0a71a-2811-406c-bc5e-fbc5350730d2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1304 microversion: 2.1 time: 0.121307 Aug 24 12:40:33.045367 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 449/900] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:32 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:34.060487 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-1ce00794-d0df-42a0-b75d-d4d075325189 req-fb6c4b6b-3fd0-486a-a231-55e153a77610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7", "tag": "154fd828-a0ba-4052-8d11-2881dad1d6e5"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:34.066115 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-131ae739-d735-46e1-91b0-33c8ee553494 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:34.067236 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-131ae739-d735-46e1-91b0-33c8ee553494 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:34.071225 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-1ce00794-d0df-42a0-b75d-d4d075325189 req-fb6c4b6b-3fd0-486a-a231-55e153a77610 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:34.071807 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-1ce00794-d0df-42a0-b75d-d4d075325189 req-fb6c4b6b-3fd0-486a-a231-55e153a77610 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:34.072344 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-1ce00794-d0df-42a0-b75d-d4d075325189 req-fb6c4b6b-3fd0-486a-a231-55e153a77610 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:34.073775 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-131ae739-d735-46e1-91b0-33c8ee553494 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:34.074530 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-131ae739-d735-46e1-91b0-33c8ee553494 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:34.074973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-131ae739-d735-46e1-91b0-33c8ee553494 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:34.079559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-131ae739-d735-46e1-91b0-33c8ee553494 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:34.080588 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-131ae739-d735-46e1-91b0-33c8ee553494 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:34.080588 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-131ae739-d735-46e1-91b0-33c8ee553494 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:34.084878 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-1ce00794-d0df-42a0-b75d-d4d075325189 req-fb6c4b6b-3fd0-486a-a231-55e153a77610 service nova] Creating event network-changed:154fd828-a0ba-4052-8d11-2881dad1d6e5 for instance dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 on hv-cinder-84890 Aug 24 12:40:34.090676 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-1ce00794-d0df-42a0-b75d-d4d075325189 req-fb6c4b6b-3fd0-486a-a231-55e153a77610 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034661 Aug 24 12:40:34.092432 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 452/901] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:34.115000 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-131ae739-d735-46e1-91b0-33c8ee553494 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:34.115485 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-131ae739-d735-46e1-91b0-33c8ee553494 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:34.115952 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-131ae739-d735-46e1-91b0-33c8ee553494 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:34.116394 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-131ae739-d735-46e1-91b0-33c8ee553494 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lazy-loading 'fault' on Instance uuid 26c20576-80ad-4147-b881-ed9af3763364 {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:40:34.159288 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-131ae739-d735-46e1-91b0-33c8ee553494 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:34.166912 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-131ae739-d735-46e1-91b0-33c8ee553494 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1304 microversion: 2.1 time: 0.104644 Aug 24 12:40:34.167466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 450/902] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:34 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:35.189828 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5cc6d048-fef2-498a-8a95-2afebf1b04c6 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:35.191216 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5cc6d048-fef2-498a-8a95-2afebf1b04c6 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:35.199521 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5cc6d048-fef2-498a-8a95-2afebf1b04c6 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:35.201235 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5cc6d048-fef2-498a-8a95-2afebf1b04c6 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:35.201755 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5cc6d048-fef2-498a-8a95-2afebf1b04c6 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:35.202720 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5cc6d048-fef2-498a-8a95-2afebf1b04c6 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:35.203278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5cc6d048-fef2-498a-8a95-2afebf1b04c6 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:35.203809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5cc6d048-fef2-498a-8a95-2afebf1b04c6 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:35.237560 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5cc6d048-fef2-498a-8a95-2afebf1b04c6 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:35.238048 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5cc6d048-fef2-498a-8a95-2afebf1b04c6 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:35.238475 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5cc6d048-fef2-498a-8a95-2afebf1b04c6 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:35.238922 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.objects.instance [None req-5cc6d048-fef2-498a-8a95-2afebf1b04c6 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lazy-loading 'fault' on Instance uuid 26c20576-80ad-4147-b881-ed9af3763364 {{(pid=127307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:40:35.281027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5cc6d048-fef2-498a-8a95-2afebf1b04c6 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:35.287945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5cc6d048-fef2-498a-8a95-2afebf1b04c6 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 200 len: 1304 microversion: 2.1 time: 0.103192 Aug 24 12:40:35.288744 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 453/903] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:35 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:36.309035 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-aecc2c25-9baf-47fa-9d0e-48fd5167d1db tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:36.309648 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-aecc2c25-9baf-47fa-9d0e-48fd5167d1db tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 26c20576-80ad-4147-b881-ed9af3763364] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:36.316110 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-aecc2c25-9baf-47fa-9d0e-48fd5167d1db tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:36.316521 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-aecc2c25-9baf-47fa-9d0e-48fd5167d1db tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:36.316957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-aecc2c25-9baf-47fa-9d0e-48fd5167d1db tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:36.317641 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-aecc2c25-9baf-47fa-9d0e-48fd5167d1db tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:36.318090 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-aecc2c25-9baf-47fa-9d0e-48fd5167d1db tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:36.318509 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-aecc2c25-9baf-47fa-9d0e-48fd5167d1db tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:36.332000 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-aecc2c25-9baf-47fa-9d0e-48fd5167d1db tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] HTTP exception thrown: Instance 26c20576-80ad-4147-b881-ed9af3763364 could not be found. Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-aecc2c25-9baf-47fa-9d0e-48fd5167d1db tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Request method failure captured: Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 HTTP/1.1 Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhwnIZXiBZoV03G51AQ8gMizP_8EuUQNweNtYuK5g-mlLg7nCw8xE64hEwH_O5lvZJmukeEAx5W-iqkelYAyA3aIaO6PYnx8CB7RCKihUP_IJreHNNfqIfJ3XUBvKhnERt4rqgFN6qLZu0AsUGxbvjtXqagxED81DN8WfTDunmRsMGc Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: a6ce654b8dc4435981cb395c4b887ae7 Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-VolumesActionsTest-1879299886 Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:40:36.333623 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:40:36.335316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a6ce654b8dc4435981cb395c4b887ae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a6ce654b8dc4435981cb395c4b887ae7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a6ce654b8dc4435981cb395c4b887ae7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a6ce654b8dc4435981cb395c4b887ae7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:40:36.335316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-VolumesActionsTest-1879299886 Aug 24 12:40:36.335316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: a6ce654b8dc4435981cb395c4b887ae7 Aug 24 12:40:36.335316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-VolumesActionsTest-1879299886 Aug 24 12:40:36.335316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-VolumesActionsTest-1879299886-project Aug 24 12:40:36.335316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:40:36.335316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:40:36.335316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 25fad82cbf944d7db13d6bf33d3297a1 Aug 24 12:40:36.335316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-VolumesActionsTest-1879299886-project Aug 24 12:40:36.335316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:40:36.335316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance 26c20576-80ad-4147-b881-ed9af3763364 could not be found. Aug 24 12:40:36.335316 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '26c20576-80ad-4147-b881-ed9af3763364'} Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c20576-80ad-4147-b881-ed9af3763364 could not be found. Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:36.336401 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c20576-80ad-4147-b881-ed9af3763364 could not be found. Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c20576-80ad-4147-b881-ed9af3763364 could not be found. Aug 24 12:40:36.338278 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:40:36.340379 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-aecc2c25-9baf-47fa-9d0e-48fd5167d1db tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Returning 404 to user: Instance 26c20576-80ad-4147-b881-ed9af3763364 could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:36.340379 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-aecc2c25-9baf-47fa-9d0e-48fd5167d1db tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364" status: 404 len: 111 microversion: 2.1 time: 0.029880 Aug 24 12:40:36.340379 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 451/904] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:36 2022] GET /compute/v2.1/servers/26c20576-80ad-4147-b881-ed9af3763364 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:36.440059 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1643045823", "imageRef": "0a0bedbd-bec2-40bd-a1b1-0976a24e86a7", "flavorRef": "452", "networks": [{"uuid": "48e7bf8b-f9f8-45a5-b18e-b0f0f9c70061"}]}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:36.495552 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.network.neutron [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] validate_networks() for [('48e7bf8b-f9f8-45a5-b18e-b0f0f9c70061', None, None, None, None, None)] {{(pid=127307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:40:36.844537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Flavor limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:40:36.844962 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Image limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:40:36.845438 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Flavor pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:40:36.845964 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Image pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:40:36.846383 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:40:36.855117 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:36.855539 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:36.856010 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:36.857424 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:36.857878 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:36.858332 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:36.885394 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Getting quotas for project a6ce654b8dc4435981cb395c4b887ae7. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:40:36.890810 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Getting quotas for user 25fad82cbf944d7db13d6bf33d3297a1 and project a6ce654b8dc4435981cb395c4b887ae7. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:40:36.901806 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Going to run 1 instances... {{(pid=127307) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:40:36.904775 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a0bedbd-bec2-40bd-a1b1-0976a24e86a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:40:36.952108 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-86838f22-99b8-4efb-85b5-79a1afbd5102 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515834 Aug 24 12:40:36.952743 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 454/905] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:40:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:40:36.964193 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-387ac97c-694a-4c71-9da4-6e81033eee97 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:36.964803 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-387ac97c-694a-4c71-9da4-6e81033eee97 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:37.024182 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-387ac97c-694a-4c71-9da4-6e81033eee97 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:37.031769 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-387ac97c-694a-4c71-9da4-6e81033eee97 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1214 microversion: 2.1 time: 0.071703 Aug 24 12:40:37.032328 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 452/906] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:36 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:38.052562 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-fc64539d-b2c1-42c4-ba12-ac4a6aed56fb tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:38.053178 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-fc64539d-b2c1-42c4-ba12-ac4a6aed56fb tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:38.059277 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc64539d-b2c1-42c4-ba12-ac4a6aed56fb tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:38.060433 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc64539d-b2c1-42c4-ba12-ac4a6aed56fb tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:38.060879 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc64539d-b2c1-42c4-ba12-ac4a6aed56fb tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:38.061597 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc64539d-b2c1-42c4-ba12-ac4a6aed56fb tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:38.062056 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc64539d-b2c1-42c4-ba12-ac4a6aed56fb tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:38.062480 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fc64539d-b2c1-42c4-ba12-ac4a6aed56fb tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:38.128236 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-fc64539d-b2c1-42c4-ba12-ac4a6aed56fb tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:38.145583 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-fc64539d-b2c1-42c4-ba12-ac4a6aed56fb tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1210 microversion: 2.1 time: 0.097231 Aug 24 12:40:38.146310 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 455/907] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:38 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:39.167049 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-dfdb1968-9dc5-4952-9f54-25e2b51abb37 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:39.167604 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-dfdb1968-9dc5-4952-9f54-25e2b51abb37 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:39.175315 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-dfdb1968-9dc5-4952-9f54-25e2b51abb37 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:39.175834 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-dfdb1968-9dc5-4952-9f54-25e2b51abb37 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:39.176269 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-dfdb1968-9dc5-4952-9f54-25e2b51abb37 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:39.176956 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-dfdb1968-9dc5-4952-9f54-25e2b51abb37 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:39.177410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-dfdb1968-9dc5-4952-9f54-25e2b51abb37 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:39.177835 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-dfdb1968-9dc5-4952-9f54-25e2b51abb37 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:39.239710 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-dfdb1968-9dc5-4952-9f54-25e2b51abb37 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:39.243052 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:39.248030 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-dfdb1968-9dc5-4952-9f54-25e2b51abb37 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1266 microversion: 2.1 time: 0.084851 Aug 24 12:40:39.248618 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 453/908] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:39 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:40.268928 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-95518cb7-258d-4315-8d0d-9741371dae34 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:40.269489 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-95518cb7-258d-4315-8d0d-9741371dae34 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:40.275872 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-95518cb7-258d-4315-8d0d-9741371dae34 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:40.276634 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-95518cb7-258d-4315-8d0d-9741371dae34 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:40.277077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-95518cb7-258d-4315-8d0d-9741371dae34 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:40.277774 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-95518cb7-258d-4315-8d0d-9741371dae34 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:40.278364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-95518cb7-258d-4315-8d0d-9741371dae34 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:40.278799 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-95518cb7-258d-4315-8d0d-9741371dae34 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:40.341513 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-95518cb7-258d-4315-8d0d-9741371dae34 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:40.349574 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-95518cb7-258d-4315-8d0d-9741371dae34 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1266 microversion: 2.1 time: 0.084590 Aug 24 12:40:40.350145 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 456/909] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:40 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:41.370208 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-40715290-898f-4d7e-8c43-8abe19e2bdd4 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:41.370821 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-40715290-898f-4d7e-8c43-8abe19e2bdd4 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:41.379739 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-40715290-898f-4d7e-8c43-8abe19e2bdd4 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:41.380216 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-40715290-898f-4d7e-8c43-8abe19e2bdd4 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:41.380651 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-40715290-898f-4d7e-8c43-8abe19e2bdd4 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:41.381338 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-40715290-898f-4d7e-8c43-8abe19e2bdd4 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:41.381796 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-40715290-898f-4d7e-8c43-8abe19e2bdd4 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:41.382216 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-40715290-898f-4d7e-8c43-8abe19e2bdd4 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:41.450205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-40715290-898f-4d7e-8c43-8abe19e2bdd4 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:41.460455 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-40715290-898f-4d7e-8c43-8abe19e2bdd4 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1266 microversion: 2.1 time: 0.094027 Aug 24 12:40:41.463756 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 454/910] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:41 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:42.483797 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8c6c87eb-ef0c-4807-8769-f64596f63c77 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:42.485261 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8c6c87eb-ef0c-4807-8769-f64596f63c77 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:42.507011 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c6c87eb-ef0c-4807-8769-f64596f63c77 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:42.510147 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c6c87eb-ef0c-4807-8769-f64596f63c77 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:42.510833 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c6c87eb-ef0c-4807-8769-f64596f63c77 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:42.514716 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c6c87eb-ef0c-4807-8769-f64596f63c77 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:42.515796 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c6c87eb-ef0c-4807-8769-f64596f63c77 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:42.516617 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8c6c87eb-ef0c-4807-8769-f64596f63c77 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:42.820094 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8c6c87eb-ef0c-4807-8769-f64596f63c77 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:42.829261 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8c6c87eb-ef0c-4807-8769-f64596f63c77 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1314 microversion: 2.1 time: 0.350998 Aug 24 12:40:42.845362 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 457/911] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:42 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:43.140524 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-284f05b0-e9da-4a48-a2de-b5ad52b2ca67 req-ed49cf05-a3a9-49d9-92af-30041c31ffef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f3ef16-d6ed-447e-8896-4382e5a7edce", "tag": "8772faaf-f034-4d92-b8e6-07ffd0e9babd"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:43.151076 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-284f05b0-e9da-4a48-a2de-b5ad52b2ca67 req-ed49cf05-a3a9-49d9-92af-30041c31ffef service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:43.151591 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-284f05b0-e9da-4a48-a2de-b5ad52b2ca67 req-ed49cf05-a3a9-49d9-92af-30041c31ffef service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:43.152042 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-284f05b0-e9da-4a48-a2de-b5ad52b2ca67 req-ed49cf05-a3a9-49d9-92af-30041c31ffef service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:43.167549 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-284f05b0-e9da-4a48-a2de-b5ad52b2ca67 req-ed49cf05-a3a9-49d9-92af-30041c31ffef service nova] Creating event network-changed:8772faaf-f034-4d92-b8e6-07ffd0e9babd for instance 43f3ef16-d6ed-447e-8896-4382e5a7edce on hv-cinder-84890 Aug 24 12:40:43.174976 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-284f05b0-e9da-4a48-a2de-b5ad52b2ca67 req-ed49cf05-a3a9-49d9-92af-30041c31ffef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037972 Aug 24 12:40:43.176508 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 455/912] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:43.853035 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ea65c16c-8808-4df2-a989-9be0c2d86914 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:43.854773 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ea65c16c-8808-4df2-a989-9be0c2d86914 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:43.863190 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea65c16c-8808-4df2-a989-9be0c2d86914 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:43.864198 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea65c16c-8808-4df2-a989-9be0c2d86914 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:43.864812 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea65c16c-8808-4df2-a989-9be0c2d86914 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:43.865759 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea65c16c-8808-4df2-a989-9be0c2d86914 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:43.866607 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea65c16c-8808-4df2-a989-9be0c2d86914 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:43.867504 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ea65c16c-8808-4df2-a989-9be0c2d86914 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:43.874952 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=100 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:44.031146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ea65c16c-8808-4df2-a989-9be0c2d86914 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:44.038762 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ea65c16c-8808-4df2-a989-9be0c2d86914 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1314 microversion: 2.1 time: 0.192244 Aug 24 12:40:44.039327 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 458/913] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:43 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:45.077749 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c2e38910-cd19-4af1-9391-0c02d123dd87 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:45.080107 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c2e38910-cd19-4af1-9391-0c02d123dd87 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:45.088956 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c2e38910-cd19-4af1-9391-0c02d123dd87 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:45.089714 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c2e38910-cd19-4af1-9391-0c02d123dd87 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:45.090314 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c2e38910-cd19-4af1-9391-0c02d123dd87 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:45.091172 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c2e38910-cd19-4af1-9391-0c02d123dd87 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:45.091869 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c2e38910-cd19-4af1-9391-0c02d123dd87 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:45.092444 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c2e38910-cd19-4af1-9391-0c02d123dd87 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:45.401631 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c2e38910-cd19-4af1-9391-0c02d123dd87 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:45.410119 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c2e38910-cd19-4af1-9391-0c02d123dd87 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1314 microversion: 2.1 time: 0.352078 Aug 24 12:40:45.410956 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 456/914] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:45 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:46.103952 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-52960271-1665-4d22-9b17-9ab47197bac1 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:46.104450 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-52960271-1665-4d22-9b17-9ab47197bac1 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:46.111177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-52960271-1665-4d22-9b17-9ab47197bac1 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:46.111720 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-52960271-1665-4d22-9b17-9ab47197bac1 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:46.112156 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-52960271-1665-4d22-9b17-9ab47197bac1 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:46.112843 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-52960271-1665-4d22-9b17-9ab47197bac1 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:46.113292 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-52960271-1665-4d22-9b17-9ab47197bac1 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:46.113711 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-52960271-1665-4d22-9b17-9ab47197bac1 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:46.205644 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.objects.instance [None req-52960271-1665-4d22-9b17-9ab47197bac1 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lazy-loading 'services' on Instance uuid c606e495-b7a7-4d6e-b5a5-5ff311442a3a {{(pid=127307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:40:46.287799 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-52960271-1665-4d22-9b17-9ab47197bac1 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a/os-volume_attachments/6d01cc85-8bdf-47ae-955d-f93e4677c632" status: 202 len: 0 microversion: 2.1 time: 0.187542 Aug 24 12:40:46.288395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 459/915] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 12:40:46 2022] DELETE /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a/os-volume_attachments/6d01cc85-8bdf-47ae-955d-f93e4677c632 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:40:46.433864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-fd416ca9-15cc-44bd-abe4-1b4e535e1850 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:46.434466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-fd416ca9-15cc-44bd-abe4-1b4e535e1850 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:46.441286 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fd416ca9-15cc-44bd-abe4-1b4e535e1850 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:46.441783 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fd416ca9-15cc-44bd-abe4-1b4e535e1850 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:46.442216 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fd416ca9-15cc-44bd-abe4-1b4e535e1850 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:46.442914 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fd416ca9-15cc-44bd-abe4-1b4e535e1850 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:46.443363 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fd416ca9-15cc-44bd-abe4-1b4e535e1850 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:46.443808 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-fd416ca9-15cc-44bd-abe4-1b4e535e1850 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:46.720605 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-fd416ca9-15cc-44bd-abe4-1b4e535e1850 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:46.728310 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-fd416ca9-15cc-44bd-abe4-1b4e535e1850 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1314 microversion: 2.1 time: 0.298712 Aug 24 12:40:46.728863 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 457/916] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:46 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:47.445187 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0e775c5f-968f-46d5-a077-59bb1a9fd08f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:47.445842 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0e775c5f-968f-46d5-a077-59bb1a9fd08f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:47.447967 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:47.449082 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=6 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:47.459593 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0e775c5f-968f-46d5-a077-59bb1a9fd08f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:47.460207 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0e775c5f-968f-46d5-a077-59bb1a9fd08f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:47.460714 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0e775c5f-968f-46d5-a077-59bb1a9fd08f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:47.461616 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0e775c5f-968f-46d5-a077-59bb1a9fd08f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:47.462067 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0e775c5f-968f-46d5-a077-59bb1a9fd08f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:47.462574 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0e775c5f-968f-46d5-a077-59bb1a9fd08f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:47.492606 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0e775c5f-968f-46d5-a077-59bb1a9fd08f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Going to try to terminate instance {{(pid=127307) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:40:47.585083 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0e775c5f-968f-46d5-a077-59bb1a9fd08f tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 204 len: 0 microversion: 2.1 time: 0.144225 Aug 24 12:40:47.585677 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 460/917] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:40:47 2022] DELETE /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:40:47.602565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d14e303b-6038-4f36-908f-7475adcb0b11 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:47.603199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d14e303b-6038-4f36-908f-7475adcb0b11 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:47.609709 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:47.621378 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d14e303b-6038-4f36-908f-7475adcb0b11 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:47.626322 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d14e303b-6038-4f36-908f-7475adcb0b11 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:47.627448 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d14e303b-6038-4f36-908f-7475adcb0b11 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:47.628244 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d14e303b-6038-4f36-908f-7475adcb0b11 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:47.630255 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d14e303b-6038-4f36-908f-7475adcb0b11 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:47.630699 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d14e303b-6038-4f36-908f-7475adcb0b11 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:47.754494 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-33ae501f-9e0f-42f3-9400-4a760d4d8c18 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:47.757019 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-33ae501f-9e0f-42f3-9400-4a760d4d8c18 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:47.764818 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-33ae501f-9e0f-42f3-9400-4a760d4d8c18 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:47.765720 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-33ae501f-9e0f-42f3-9400-4a760d4d8c18 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:47.766372 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-33ae501f-9e0f-42f3-9400-4a760d4d8c18 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:47.767261 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-33ae501f-9e0f-42f3-9400-4a760d4d8c18 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:47.774489 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-33ae501f-9e0f-42f3-9400-4a760d4d8c18 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:47.775009 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-33ae501f-9e0f-42f3-9400-4a760d4d8c18 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:47.862949 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d14e303b-6038-4f36-908f-7475adcb0b11 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:47.891575 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d14e303b-6038-4f36-908f-7475adcb0b11 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1514 microversion: 2.1 time: 0.301135 Aug 24 12:40:47.902498 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 458/918] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:47 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1514 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:48.041143 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-33ae501f-9e0f-42f3-9400-4a760d4d8c18 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:48.049703 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-33ae501f-9e0f-42f3-9400-4a760d4d8c18 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1314 microversion: 2.1 time: 0.302796 Aug 24 12:40:48.050562 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 461/919] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:47 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:48.914514 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e6a36d15-c310-4533-814e-dc02c876ad48 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:48.915272 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e6a36d15-c310-4533-814e-dc02c876ad48 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:48.921701 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e6a36d15-c310-4533-814e-dc02c876ad48 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:48.922681 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e6a36d15-c310-4533-814e-dc02c876ad48 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:48.923569 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e6a36d15-c310-4533-814e-dc02c876ad48 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:48.924544 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e6a36d15-c310-4533-814e-dc02c876ad48 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:48.925205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e6a36d15-c310-4533-814e-dc02c876ad48 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:48.925852 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e6a36d15-c310-4533-814e-dc02c876ad48 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:48.939398 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-f9f04760-f9a2-4858-8de0-ccf7f6463781 req-2dd1910a-d0f3-4b63-bd55-bbe3e3f4d482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f3ef16-d6ed-447e-8896-4382e5a7edce", "name": "network-vif-plugged", "status": "completed", "tag": "8772faaf-f034-4d92-b8e6-07ffd0e9babd"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:48.955644 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-f9f04760-f9a2-4858-8de0-ccf7f6463781 req-2dd1910a-d0f3-4b63-bd55-bbe3e3f4d482 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:48.956440 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-f9f04760-f9a2-4858-8de0-ccf7f6463781 req-2dd1910a-d0f3-4b63-bd55-bbe3e3f4d482 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:48.957370 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-f9f04760-f9a2-4858-8de0-ccf7f6463781 req-2dd1910a-d0f3-4b63-bd55-bbe3e3f4d482 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:48.972539 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-f9f04760-f9a2-4858-8de0-ccf7f6463781 req-2dd1910a-d0f3-4b63-bd55-bbe3e3f4d482 service nova] Creating event network-vif-plugged:8772faaf-f034-4d92-b8e6-07ffd0e9babd for instance 43f3ef16-d6ed-447e-8896-4382e5a7edce on hv-cinder-84890 Aug 24 12:40:48.994624 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-f9f04760-f9a2-4858-8de0-ccf7f6463781 req-2dd1910a-d0f3-4b63-bd55-bbe3e3f4d482 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056637 Aug 24 12:40:48.996640 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 462/920] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:49.073384 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-636f20dd-7466-4f4e-8379-44f574cb3105 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:49.074374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-636f20dd-7466-4f4e-8379-44f574cb3105 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:49.092559 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-636f20dd-7466-4f4e-8379-44f574cb3105 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:49.093065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-636f20dd-7466-4f4e-8379-44f574cb3105 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:49.093502 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-636f20dd-7466-4f4e-8379-44f574cb3105 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:49.094215 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-636f20dd-7466-4f4e-8379-44f574cb3105 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:49.094673 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-636f20dd-7466-4f4e-8379-44f574cb3105 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:49.095749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-636f20dd-7466-4f4e-8379-44f574cb3105 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:49.132133 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e6a36d15-c310-4533-814e-dc02c876ad48 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:49.142396 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e6a36d15-c310-4533-814e-dc02c876ad48 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1514 microversion: 2.1 time: 0.231818 Aug 24 12:40:49.144565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 459/921] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:48 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:49.291282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-636f20dd-7466-4f4e-8379-44f574cb3105 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:49.303022 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-636f20dd-7466-4f4e-8379-44f574cb3105 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1314 microversion: 2.1 time: 0.235380 Aug 24 12:40:49.304133 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 463/922] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:49 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:49.846090 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-aea86d46-56f4-4509-b25c-7d7e73636144 req-e9c88310-16a7-4b73-b8fa-d07ad4cc9fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c606e495-b7a7-4d6e-b5a5-5ff311442a3a", "name": "network-vif-deleted", "tag": "4a8e2efd-9085-42b3-aceb-2009f0c5c0ad"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:49.873036 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-aea86d46-56f4-4509-b25c-7d7e73636144 req-e9c88310-16a7-4b73-b8fa-d07ad4cc9fdd service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:49.874639 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-aea86d46-56f4-4509-b25c-7d7e73636144 req-e9c88310-16a7-4b73-b8fa-d07ad4cc9fdd service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:49.875200 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-aea86d46-56f4-4509-b25c-7d7e73636144 req-e9c88310-16a7-4b73-b8fa-d07ad4cc9fdd service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:49.894800 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-aea86d46-56f4-4509-b25c-7d7e73636144 req-e9c88310-16a7-4b73-b8fa-d07ad4cc9fdd service nova] Creating event network-vif-deleted:4a8e2efd-9085-42b3-aceb-2009f0c5c0ad for instance c606e495-b7a7-4d6e-b5a5-5ff311442a3a on hv-cinder-84890 Aug 24 12:40:49.901253 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-aea86d46-56f4-4509-b25c-7d7e73636144 req-e9c88310-16a7-4b73-b8fa-d07ad4cc9fdd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061283 Aug 24 12:40:49.902296 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 460/923] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:50.166064 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-bd7f01dd-7534-4c60-9cbe-39b3630604d7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:50.167010 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-bd7f01dd-7534-4c60-9cbe-39b3630604d7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:50.176287 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bd7f01dd-7534-4c60-9cbe-39b3630604d7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:50.176943 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bd7f01dd-7534-4c60-9cbe-39b3630604d7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:50.177444 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bd7f01dd-7534-4c60-9cbe-39b3630604d7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:50.178380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bd7f01dd-7534-4c60-9cbe-39b3630604d7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:50.178848 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bd7f01dd-7534-4c60-9cbe-39b3630604d7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:50.179275 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bd7f01dd-7534-4c60-9cbe-39b3630604d7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:50.259381 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-bd7f01dd-7534-4c60-9cbe-39b3630604d7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c40bc0027e94421a1da7b8016307b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474008375491499b85702c8824bd1981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:50.268639 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-bd7f01dd-7534-4c60-9cbe-39b3630604d7 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 200 len: 1303 microversion: 2.1 time: 0.107308 Aug 24 12:40:50.269772 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 464/924] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:50 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:50.328470 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-6b1ddb4f-2a06-4965-a784-74d01c477415 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:50.329391 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-6b1ddb4f-2a06-4965-a784-74d01c477415 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:50.336441 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6b1ddb4f-2a06-4965-a784-74d01c477415 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:50.336984 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6b1ddb4f-2a06-4965-a784-74d01c477415 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:50.337519 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6b1ddb4f-2a06-4965-a784-74d01c477415 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:50.338364 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6b1ddb4f-2a06-4965-a784-74d01c477415 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:50.338928 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6b1ddb4f-2a06-4965-a784-74d01c477415 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:50.339456 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6b1ddb4f-2a06-4965-a784-74d01c477415 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:50.487183 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6b1ddb4f-2a06-4965-a784-74d01c477415 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:50.496915 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-6b1ddb4f-2a06-4965-a784-74d01c477415 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1314 microversion: 2.1 time: 0.173579 Aug 24 12:40:50.498139 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 461/925] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:50 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:51.291248 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-66908b79-1036-4c20-8392-0b49f4d4feb4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:51.292106 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-66908b79-1036-4c20-8392-0b49f4d4feb4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] [instance: c606e495-b7a7-4d6e-b5a5-5ff311442a3a] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:51.300822 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66908b79-1036-4c20-8392-0b49f4d4feb4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:51.301645 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66908b79-1036-4c20-8392-0b49f4d4feb4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:51.302004 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66908b79-1036-4c20-8392-0b49f4d4feb4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:51.302750 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66908b79-1036-4c20-8392-0b49f4d4feb4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:51.303243 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66908b79-1036-4c20-8392-0b49f4d4feb4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:51.303749 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66908b79-1036-4c20-8392-0b49f4d4feb4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:51.319771 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-66908b79-1036-4c20-8392-0b49f4d4feb4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] HTTP exception thrown: Instance c606e495-b7a7-4d6e-b5a5-5ff311442a3a could not be found. Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-66908b79-1036-4c20-8392-0b49f4d4feb4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Request method failure captured: Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a HTTP/1.1 Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhvMj0O9erA_ZCsnM9t5bcbMUipckqt3jnZDXPhI5Yn7-2FUoA7cjS_mOw5fn7IgFP1j3Pf7vJ3cwVXOdbxhVxFkmSD8wHqgBJO0WAGkWG1IW6gEC3wTtFQSkGvoT6mDHg0jcYIG_IaIqTkly74ISGq7uqaqjSUXqcCbsNoE6NoyfUM Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: 474008375491499b85702c8824bd1981 Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1619250705 Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:40:51.321623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:40:51.323402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474008375491499b85702c8824bd1981"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/474008375491499b85702c8824bd1981"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/474008375491499b85702c8824bd1981"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_474008375491499b85702c8824bd1981"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:40:51.323402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-VolumesSnapshotTestJSON-1619250705 Aug 24 12:40:51.323402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: 474008375491499b85702c8824bd1981 Aug 24 12:40:51.323402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1619250705 Aug 24 12:40:51.323402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-VolumesSnapshotTestJSON-1619250705-project Aug 24 12:40:51.323402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:40:51.323402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:40:51.323402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 9c40bc0027e94421a1da7b8016307b67 Aug 24 12:40:51.323402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-VolumesSnapshotTestJSON-1619250705-project Aug 24 12:40:51.323402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:40:51.323402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance c606e495-b7a7-4d6e-b5a5-5ff311442a3a could not be found. Aug 24 12:40:51.323402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': 'c606e495-b7a7-4d6e-b5a5-5ff311442a3a'} Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c606e495-b7a7-4d6e-b5a5-5ff311442a3a could not be found. Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:51.324682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c606e495-b7a7-4d6e-b5a5-5ff311442a3a could not be found. Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c606e495-b7a7-4d6e-b5a5-5ff311442a3a could not be found. Aug 24 12:40:51.326575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:40:51.329368 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-66908b79-1036-4c20-8392-0b49f4d4feb4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] Returning 404 to user: Instance c606e495-b7a7-4d6e-b5a5-5ff311442a3a could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:51.330241 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-66908b79-1036-4c20-8392-0b49f4d4feb4 tempest-VolumesSnapshotTestJSON-1619250705 tempest-VolumesSnapshotTestJSON-1619250705-project] 10.222.0.58 "GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a" status: 404 len: 111 microversion: 2.1 time: 0.043879 Aug 24 12:40:51.330811 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 465/926] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:51 2022] GET /compute/v2.1/servers/c606e495-b7a7-4d6e-b5a5-5ff311442a3a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:51.518896 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ec770181-f325-40f1-8599-dc5208f7b85d tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:51.520481 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-ec770181-f325-40f1-8599-dc5208f7b85d tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:51.528481 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ec770181-f325-40f1-8599-dc5208f7b85d tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:51.529402 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ec770181-f325-40f1-8599-dc5208f7b85d tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:51.530061 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ec770181-f325-40f1-8599-dc5208f7b85d tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:51.530980 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ec770181-f325-40f1-8599-dc5208f7b85d tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:51.531654 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ec770181-f325-40f1-8599-dc5208f7b85d tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:51.532280 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ec770181-f325-40f1-8599-dc5208f7b85d tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:51.743295 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ec770181-f325-40f1-8599-dc5208f7b85d tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:51.752602 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-ec770181-f325-40f1-8599-dc5208f7b85d tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1499 microversion: 2.1 time: 0.237490 Aug 24 12:40:51.753699 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 462/927] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:51 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1499 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:52.431232 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-42451573-cade-4460-b216-9c292cd5c264 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:52.432688 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-42451573-cade-4460-b216-9c292cd5c264 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:52.443144 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-42451573-cade-4460-b216-9c292cd5c264 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:52.444072 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-42451573-cade-4460-b216-9c292cd5c264 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:52.445041 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-42451573-cade-4460-b216-9c292cd5c264 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:52.446002 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-42451573-cade-4460-b216-9c292cd5c264 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:52.446738 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-42451573-cade-4460-b216-9c292cd5c264 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:52.447401 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-42451573-cade-4460-b216-9c292cd5c264 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:52.478671 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-42451573-cade-4460-b216-9c292cd5c264 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Going to try to terminate instance {{(pid=127307) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:40:52.621699 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-42451573-cade-4460-b216-9c292cd5c264 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "DELETE /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 204 len: 0 microversion: 2.1 time: 0.200284 Aug 24 12:40:52.623078 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 466/928] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:40:52 2022] DELETE /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:40:52.631556 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2bb20cbe-1178-4b59-92ce-53e3053b4032 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:52.632353 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2bb20cbe-1178-4b59-92ce-53e3053b4032 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:52.639600 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2bb20cbe-1178-4b59-92ce-53e3053b4032 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:52.640124 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2bb20cbe-1178-4b59-92ce-53e3053b4032 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:52.640588 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2bb20cbe-1178-4b59-92ce-53e3053b4032 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:52.641293 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2bb20cbe-1178-4b59-92ce-53e3053b4032 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:52.641749 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2bb20cbe-1178-4b59-92ce-53e3053b4032 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:52.642334 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2bb20cbe-1178-4b59-92ce-53e3053b4032 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:53.264064 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2bb20cbe-1178-4b59-92ce-53e3053b4032 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:53.273901 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2bb20cbe-1178-4b59-92ce-53e3053b4032 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1505 microversion: 2.1 time: 0.646425 Aug 24 12:40:53.275694 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 463/929] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:52 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1505 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:54.300154 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8415f118-6517-494c-8a08-6c7644eb73f2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:54.301787 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8415f118-6517-494c-8a08-6c7644eb73f2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:54.316652 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8415f118-6517-494c-8a08-6c7644eb73f2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:54.318264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8415f118-6517-494c-8a08-6c7644eb73f2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:54.319013 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8415f118-6517-494c-8a08-6c7644eb73f2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:54.320404 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8415f118-6517-494c-8a08-6c7644eb73f2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:54.321101 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8415f118-6517-494c-8a08-6c7644eb73f2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:54.323109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8415f118-6517-494c-8a08-6c7644eb73f2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:54.603875 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8415f118-6517-494c-8a08-6c7644eb73f2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:54.612911 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8415f118-6517-494c-8a08-6c7644eb73f2 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1505 microversion: 2.1 time: 0.319787 Aug 24 12:40:54.613469 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 467/930] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:54 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:55.636708 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-16fa7b37-7290-4527-a829-a3cabc3f195e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:55.637301 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-16fa7b37-7290-4527-a829-a3cabc3f195e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:55.653271 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-16fa7b37-7290-4527-a829-a3cabc3f195e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:55.654489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-16fa7b37-7290-4527-a829-a3cabc3f195e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:55.655126 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-16fa7b37-7290-4527-a829-a3cabc3f195e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:55.656114 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-16fa7b37-7290-4527-a829-a3cabc3f195e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:55.656377 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-16fa7b37-7290-4527-a829-a3cabc3f195e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:55.660365 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-16fa7b37-7290-4527-a829-a3cabc3f195e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:55.839701 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-16fa7b37-7290-4527-a829-a3cabc3f195e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:55.849307 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-16fa7b37-7290-4527-a829-a3cabc3f195e tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1505 microversion: 2.1 time: 0.218330 Aug 24 12:40:55.852653 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 464/931] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:55 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:56.874733 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e1186387-6986-4628-a368-2f1c55d60b68 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:56.875508 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e1186387-6986-4628-a368-2f1c55d60b68 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:56.889842 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e1186387-6986-4628-a368-2f1c55d60b68 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:56.890357 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e1186387-6986-4628-a368-2f1c55d60b68 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:56.890795 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e1186387-6986-4628-a368-2f1c55d60b68 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:56.891507 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e1186387-6986-4628-a368-2f1c55d60b68 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:56.892191 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e1186387-6986-4628-a368-2f1c55d60b68 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:56.892783 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e1186387-6986-4628-a368-2f1c55d60b68 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:57.100665 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e1186387-6986-4628-a368-2f1c55d60b68 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fad82cbf944d7db13d6bf33d3297a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce654b8dc4435981cb395c4b887ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:57.126383 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e1186387-6986-4628-a368-2f1c55d60b68 tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 200 len: 1505 microversion: 2.1 time: 0.256766 Aug 24 12:40:57.126957 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 468/932] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:56 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:57.174765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-e102a6db-318e-4eb1-8563-1b6dd4545d8a req-31b21be0-2a50-4775-b6f5-f1a36ecdff0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f3ef16-d6ed-447e-8896-4382e5a7edce", "name": "network-vif-deleted", "tag": "8772faaf-f034-4d92-b8e6-07ffd0e9babd"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:57.185433 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-e102a6db-318e-4eb1-8563-1b6dd4545d8a req-31b21be0-2a50-4775-b6f5-f1a36ecdff0f service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:57.186070 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-e102a6db-318e-4eb1-8563-1b6dd4545d8a req-31b21be0-2a50-4775-b6f5-f1a36ecdff0f service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:57.186695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-e102a6db-318e-4eb1-8563-1b6dd4545d8a req-31b21be0-2a50-4775-b6f5-f1a36ecdff0f service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:57.199438 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-e102a6db-318e-4eb1-8563-1b6dd4545d8a req-31b21be0-2a50-4775-b6f5-f1a36ecdff0f service nova] Creating event network-vif-deleted:8772faaf-f034-4d92-b8e6-07ffd0e9babd for instance 43f3ef16-d6ed-447e-8896-4382e5a7edce on hv-cinder-84890 Aug 24 12:40:57.205890 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-e102a6db-318e-4eb1-8563-1b6dd4545d8a req-31b21be0-2a50-4775-b6f5-f1a36ecdff0f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036988 Aug 24 12:40:57.211878 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 465/933] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:58.158969 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d537bb5c-f71e-4950-890d-69b5ea7f3c0a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:58.167453 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-d537bb5c-f71e-4950-890d-69b5ea7f3c0a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] [instance: 43f3ef16-d6ed-447e-8896-4382e5a7edce] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:58.178092 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d537bb5c-f71e-4950-890d-69b5ea7f3c0a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:58.179113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d537bb5c-f71e-4950-890d-69b5ea7f3c0a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:58.179660 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d537bb5c-f71e-4950-890d-69b5ea7f3c0a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:58.180844 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d537bb5c-f71e-4950-890d-69b5ea7f3c0a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:58.181485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d537bb5c-f71e-4950-890d-69b5ea7f3c0a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:58.182111 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-d537bb5c-f71e-4950-890d-69b5ea7f3c0a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:58.202109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-d537bb5c-f71e-4950-890d-69b5ea7f3c0a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] HTTP exception thrown: Instance 43f3ef16-d6ed-447e-8896-4382e5a7edce could not be found. Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d537bb5c-f71e-4950-890d-69b5ea7f3c0a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Request method failure captured: Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce HTTP/1.1 Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhwnIZXiBZoV03G51AQ8gMizP_8EuUQNweNtYuK5g-mlLg7nCw8xE64hEwH_O5lvZJmukeEAx5W-iqkelYAyA3aIaO6PYnx8CB7RCKihUP_IJreHNNfqIfJ3XUBvKhnERt4rqgFN6qLZu0AsUGxbvjtXqagxED81DN8WfTDunmRsMGc Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: a6ce654b8dc4435981cb395c4b887ae7 Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-VolumesActionsTest-1879299886 Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:40:58.204321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:40:58.206307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a6ce654b8dc4435981cb395c4b887ae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a6ce654b8dc4435981cb395c4b887ae7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a6ce654b8dc4435981cb395c4b887ae7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a6ce654b8dc4435981cb395c4b887ae7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:40:58.206307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-VolumesActionsTest-1879299886 Aug 24 12:40:58.206307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: a6ce654b8dc4435981cb395c4b887ae7 Aug 24 12:40:58.206307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-VolumesActionsTest-1879299886 Aug 24 12:40:58.206307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-VolumesActionsTest-1879299886-project Aug 24 12:40:58.206307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:40:58.206307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:40:58.206307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 25fad82cbf944d7db13d6bf33d3297a1 Aug 24 12:40:58.206307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-VolumesActionsTest-1879299886-project Aug 24 12:40:58.206307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:40:58.206307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance 43f3ef16-d6ed-447e-8896-4382e5a7edce could not be found. Aug 24 12:40:58.206307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': '43f3ef16-d6ed-447e-8896-4382e5a7edce'} Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f3ef16-d6ed-447e-8896-4382e5a7edce could not be found. Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:58.207113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f3ef16-d6ed-447e-8896-4382e5a7edce could not be found. Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f3ef16-d6ed-447e-8896-4382e5a7edce could not be found. Aug 24 12:40:58.213845 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:40:58.215604 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-d537bb5c-f71e-4950-890d-69b5ea7f3c0a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] Returning 404 to user: Instance 43f3ef16-d6ed-447e-8896-4382e5a7edce could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:58.215604 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-d537bb5c-f71e-4950-890d-69b5ea7f3c0a tempest-VolumesActionsTest-1879299886 tempest-VolumesActionsTest-1879299886-project] 10.222.0.58 "GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce" status: 404 len: 111 microversion: 2.1 time: 0.050429 Aug 24 12:40:58.215604 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 469/934] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:58 2022] GET /compute/v2.1/servers/43f3ef16-d6ed-447e-8896-4382e5a7edce => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:41:05.655225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d88c782e-b673-42c1-9a28-31bb1124d578 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Action: 'create', calling method: .version_select at 0x7f4696c75af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1639298170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQhSg/EV1BByabiNVOH0t1+7vkOTy9iudRu4NmLNzVFc7JNZ0Fu6xWy/rkE4ZxRYH7yxXS5Vp8Y/GnpvTPMpEVpTAu+a70JPyI5gdndyFbPtQb04rLE5PWnZeYCtnvdsg=="}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:05.663336 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=40 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:05.676492 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-d88c782e-b673-42c1-9a28-31bb1124d578 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Getting quotas for project 399ad86f3c61455bba626fd9e556e6e0. Resources: {'key_pairs'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:41:05.680563 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-d88c782e-b673-42c1-9a28-31bb1124d578 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Getting quotas for user 8aedc727a81a40c2993097e35485233c and project 399ad86f3c61455bba626fd9e556e6e0. Resources: {'key_pairs'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:41:05.707160 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d88c782e-b673-42c1-9a28-31bb1124d578 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057675 Aug 24 12:41:05.707785 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 466/935] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 12:41:05 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:05.764744 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1173101914", "imageRef": "465dc7fd-f585-4b1b-9468-57f71c4c0e61", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1639298170", "networks": [{"uuid": "7aa30bb8-f0f0-469e-95ea-085c1f68e223"}]}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:05.776900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:05.841416 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.network.neutron [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] validate_networks() for [('7aa30bb8-f0f0-469e-95ea-085c1f68e223', None, None, None, None, None)] {{(pid=127307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:41:06.285154 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Flavor limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:41:06.285944 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Image limits 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:41:06.286615 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Flavor pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:41:06.287204 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Image pref 0:0:0 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:41:06.287828 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.virt.hardware [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:41:06.306526 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:06.307016 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:06.307685 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:06.308403 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:06.308857 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:06.309840 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:06.332303 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Getting quotas for project 399ad86f3c61455bba626fd9e556e6e0. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:41:06.337877 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.quota [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Getting quotas for user 8aedc727a81a40c2993097e35485233c and project 399ad86f3c61455bba626fd9e556e6e0. Resources: {'cores', 'instances', 'ram'} {{(pid=127307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:41:06.351004 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Going to run 1 instances... {{(pid=127307) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:41:06.353255 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='465dc7fd-f585-4b1b-9468-57f71c4c0e61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:41:06.407504 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-66e69b2c-1b17-4947-9b2d-21d2e7a07f91 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647218 Aug 24 12:41:06.409034 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 470/936] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:41:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:41:06.421863 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-95dc07c3-5b35-409f-b61e-0d7cb2d38b8b tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:06.424258 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-95dc07c3-5b35-409f-b61e-0d7cb2d38b8b tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:06.504481 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-95dc07c3-5b35-409f-b61e-0d7cb2d38b8b tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:06.517717 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-95dc07c3-5b35-409f-b61e-0d7cb2d38b8b tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1259 microversion: 2.1 time: 0.101611 Aug 24 12:41:06.519098 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 467/937] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:06 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1259 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:07.539775 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-19c9b8c7-fb7a-4d70-a24f-fde04e4fca5e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:07.541059 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-19c9b8c7-fb7a-4d70-a24f-fde04e4fca5e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:07.549773 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19c9b8c7-fb7a-4d70-a24f-fde04e4fca5e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:07.550480 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19c9b8c7-fb7a-4d70-a24f-fde04e4fca5e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:07.551082 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19c9b8c7-fb7a-4d70-a24f-fde04e4fca5e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:07.552067 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19c9b8c7-fb7a-4d70-a24f-fde04e4fca5e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:07.552702 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19c9b8c7-fb7a-4d70-a24f-fde04e4fca5e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:07.553127 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-19c9b8c7-fb7a-4d70-a24f-fde04e4fca5e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:07.622851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-19c9b8c7-fb7a-4d70-a24f-fde04e4fca5e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:07.631447 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-19c9b8c7-fb7a-4d70-a24f-fde04e4fca5e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1263 microversion: 2.1 time: 0.096335 Aug 24 12:41:07.632267 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 471/938] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:07 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1263 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:08.652831 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-8b0a15d3-e0dc-4697-97a7-54de3cdd4f4a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:08.654472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-8b0a15d3-e0dc-4697-97a7-54de3cdd4f4a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:08.657000 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=60 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:08.662916 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8b0a15d3-e0dc-4697-97a7-54de3cdd4f4a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:08.663412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8b0a15d3-e0dc-4697-97a7-54de3cdd4f4a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:08.663879 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8b0a15d3-e0dc-4697-97a7-54de3cdd4f4a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:08.664626 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8b0a15d3-e0dc-4697-97a7-54de3cdd4f4a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:08.665084 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8b0a15d3-e0dc-4697-97a7-54de3cdd4f4a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:08.665514 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-8b0a15d3-e0dc-4697-97a7-54de3cdd4f4a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:08.735270 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-8b0a15d3-e0dc-4697-97a7-54de3cdd4f4a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:08.743536 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-8b0a15d3-e0dc-4697-97a7-54de3cdd4f4a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1311 microversion: 2.1 time: 0.094480 Aug 24 12:41:08.759882 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 468/939] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:08 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:09.769297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-96483edf-b4e9-48f7-9299-c23f7fa56551 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:09.770050 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-96483edf-b4e9-48f7-9299-c23f7fa56551 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:09.790165 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-96483edf-b4e9-48f7-9299-c23f7fa56551 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:09.791730 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-96483edf-b4e9-48f7-9299-c23f7fa56551 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:09.794704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-96483edf-b4e9-48f7-9299-c23f7fa56551 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:09.797735 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-96483edf-b4e9-48f7-9299-c23f7fa56551 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:09.798493 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-96483edf-b4e9-48f7-9299-c23f7fa56551 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:09.800269 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-96483edf-b4e9-48f7-9299-c23f7fa56551 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:10.205179 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-96483edf-b4e9-48f7-9299-c23f7fa56551 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:10.222271 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-96483edf-b4e9-48f7-9299-c23f7fa56551 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1359 microversion: 2.1 time: 0.457081 Aug 24 12:41:10.223010 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 472/940] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:09 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1359 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:10.970693 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-fd164c24-07e7-4d6e-9f90-c3446a7ca5d3 req-48f2952f-578c-4064-ad0e-e643a5cd91b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e9f003-88e1-43bb-8b20-9bb3c12bdb62", "tag": "7f1e74a4-26c6-4ea0-b25c-b771e422659e"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:10.995247 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-fd164c24-07e7-4d6e-9f90-c3446a7ca5d3 req-48f2952f-578c-4064-ad0e-e643a5cd91b9 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:10.998133 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-fd164c24-07e7-4d6e-9f90-c3446a7ca5d3 req-48f2952f-578c-4064-ad0e-e643a5cd91b9 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:10.998918 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-fd164c24-07e7-4d6e-9f90-c3446a7ca5d3 req-48f2952f-578c-4064-ad0e-e643a5cd91b9 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:11.028410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-fd164c24-07e7-4d6e-9f90-c3446a7ca5d3 req-48f2952f-578c-4064-ad0e-e643a5cd91b9 service nova] Creating event network-changed:7f1e74a4-26c6-4ea0-b25c-b771e422659e for instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 on hv-cinder-84890 Aug 24 12:41:11.052378 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-fd164c24-07e7-4d6e-9f90-c3446a7ca5d3 req-48f2952f-578c-4064-ad0e-e643a5cd91b9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086092 Aug 24 12:41:11.053375 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 469/941] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:11.270995 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-de62954f-f862-4d3f-99e0-9a6ffd1b1fa6 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:11.275191 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-de62954f-f862-4d3f-99e0-9a6ffd1b1fa6 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:11.290461 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-de62954f-f862-4d3f-99e0-9a6ffd1b1fa6 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:11.292136 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-de62954f-f862-4d3f-99e0-9a6ffd1b1fa6 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:11.294508 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-de62954f-f862-4d3f-99e0-9a6ffd1b1fa6 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:11.295916 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-de62954f-f862-4d3f-99e0-9a6ffd1b1fa6 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:11.304464 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-de62954f-f862-4d3f-99e0-9a6ffd1b1fa6 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:11.305256 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-de62954f-f862-4d3f-99e0-9a6ffd1b1fa6 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:11.366379 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:11.707324 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-de62954f-f862-4d3f-99e0-9a6ffd1b1fa6 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:11.723282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-de62954f-f862-4d3f-99e0-9a6ffd1b1fa6 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1359 microversion: 2.1 time: 0.474074 Aug 24 12:41:11.725174 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 473/942] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:11 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1359 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:12.757165 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-77878e4e-1bb5-46c2-8723-121e58c70eb9 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:12.758590 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-77878e4e-1bb5-46c2-8723-121e58c70eb9 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:12.768409 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77878e4e-1bb5-46c2-8723-121e58c70eb9 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:12.769237 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77878e4e-1bb5-46c2-8723-121e58c70eb9 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:12.770021 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77878e4e-1bb5-46c2-8723-121e58c70eb9 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:12.770920 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77878e4e-1bb5-46c2-8723-121e58c70eb9 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:12.771538 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77878e4e-1bb5-46c2-8723-121e58c70eb9 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:12.772421 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77878e4e-1bb5-46c2-8723-121e58c70eb9 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:12.964670 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-77878e4e-1bb5-46c2-8723-121e58c70eb9 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:12.975950 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-77878e4e-1bb5-46c2-8723-121e58c70eb9 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1359 microversion: 2.1 time: 0.224766 Aug 24 12:41:12.982733 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 470/943] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:12 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:14.009814 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9fe9b128-955d-429f-a4da-e37aec211912 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:14.011460 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-9fe9b128-955d-429f-a4da-e37aec211912 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:14.020797 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fe9b128-955d-429f-a4da-e37aec211912 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:14.021993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fe9b128-955d-429f-a4da-e37aec211912 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:14.022686 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fe9b128-955d-429f-a4da-e37aec211912 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:14.023827 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fe9b128-955d-429f-a4da-e37aec211912 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:14.024556 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fe9b128-955d-429f-a4da-e37aec211912 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:14.025209 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9fe9b128-955d-429f-a4da-e37aec211912 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:14.227844 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-9fe9b128-955d-429f-a4da-e37aec211912 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:14.238369 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9fe9b128-955d-429f-a4da-e37aec211912 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1359 microversion: 2.1 time: 0.234060 Aug 24 12:41:14.239258 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 474/944] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:14 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:15.260754 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-331109f9-df98-478a-bb79-0559ee2b421d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:15.262299 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-331109f9-df98-478a-bb79-0559ee2b421d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:15.270242 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-331109f9-df98-478a-bb79-0559ee2b421d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:15.270822 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-331109f9-df98-478a-bb79-0559ee2b421d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:15.271354 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-331109f9-df98-478a-bb79-0559ee2b421d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:15.272169 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-331109f9-df98-478a-bb79-0559ee2b421d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:15.272799 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-331109f9-df98-478a-bb79-0559ee2b421d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:15.273201 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-331109f9-df98-478a-bb79-0559ee2b421d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:15.525568 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-331109f9-df98-478a-bb79-0559ee2b421d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:15.534808 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-331109f9-df98-478a-bb79-0559ee2b421d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1359 microversion: 2.1 time: 0.278385 Aug 24 12:41:15.535385 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 471/945] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:15 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1359 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:16.557527 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-76f88ae7-b66b-4f07-b6ca-8b6e2ab72e28 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:16.558230 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-76f88ae7-b66b-4f07-b6ca-8b6e2ab72e28 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:16.569110 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:16.571233 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=6 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:16.572240 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76f88ae7-b66b-4f07-b6ca-8b6e2ab72e28 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:16.575880 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76f88ae7-b66b-4f07-b6ca-8b6e2ab72e28 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:16.576374 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76f88ae7-b66b-4f07-b6ca-8b6e2ab72e28 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:16.577154 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76f88ae7-b66b-4f07-b6ca-8b6e2ab72e28 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:16.578208 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76f88ae7-b66b-4f07-b6ca-8b6e2ab72e28 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:16.578208 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76f88ae7-b66b-4f07-b6ca-8b6e2ab72e28 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:16.869075 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-76f88ae7-b66b-4f07-b6ca-8b6e2ab72e28 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:16.892009 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-76f88ae7-b66b-4f07-b6ca-8b6e2ab72e28 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1359 microversion: 2.1 time: 0.335093 Aug 24 12:41:16.892009 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 475/946] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:16 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1359 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:17.911190 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9cb09684-d88f-4a72-85fb-fc9a9e64db52 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:17.913225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9cb09684-d88f-4a72-85fb-fc9a9e64db52 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:17.916108 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=6 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:17.940359 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9cb09684-d88f-4a72-85fb-fc9a9e64db52 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:17.941084 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9cb09684-d88f-4a72-85fb-fc9a9e64db52 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:17.941674 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9cb09684-d88f-4a72-85fb-fc9a9e64db52 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:17.942541 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9cb09684-d88f-4a72-85fb-fc9a9e64db52 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:17.943425 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9cb09684-d88f-4a72-85fb-fc9a9e64db52 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:17.944470 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9cb09684-d88f-4a72-85fb-fc9a9e64db52 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:18.206101 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9cb09684-d88f-4a72-85fb-fc9a9e64db52 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:18.218270 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9cb09684-d88f-4a72-85fb-fc9a9e64db52 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1359 microversion: 2.1 time: 0.309788 Aug 24 12:41:18.233012 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 472/947] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:17 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1359 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:19.240227 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-a21dd6a1-afd5-4e31-9310-ddb88b7eb8d4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:19.241411 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-a21dd6a1-afd5-4e31-9310-ddb88b7eb8d4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:19.250773 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a21dd6a1-afd5-4e31-9310-ddb88b7eb8d4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:19.251370 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a21dd6a1-afd5-4e31-9310-ddb88b7eb8d4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:19.252081 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a21dd6a1-afd5-4e31-9310-ddb88b7eb8d4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:19.253177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a21dd6a1-afd5-4e31-9310-ddb88b7eb8d4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:19.253865 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a21dd6a1-afd5-4e31-9310-ddb88b7eb8d4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:19.256459 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-a21dd6a1-afd5-4e31-9310-ddb88b7eb8d4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:19.564323 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-a21dd6a1-afd5-4e31-9310-ddb88b7eb8d4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:19.576467 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-a21dd6a1-afd5-4e31-9310-ddb88b7eb8d4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1359 microversion: 2.1 time: 0.337835 Aug 24 12:41:19.587263 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 476/948] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:19 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1359 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:20.599664 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-5bb807c9-7d2a-4344-bb07-b57b443006ac tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:20.600918 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-5bb807c9-7d2a-4344-bb07-b57b443006ac tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:20.607981 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bb807c9-7d2a-4344-bb07-b57b443006ac tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:20.608464 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bb807c9-7d2a-4344-bb07-b57b443006ac tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:20.608893 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bb807c9-7d2a-4344-bb07-b57b443006ac tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:20.609579 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bb807c9-7d2a-4344-bb07-b57b443006ac tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:20.610025 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bb807c9-7d2a-4344-bb07-b57b443006ac tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:20.610442 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-5bb807c9-7d2a-4344-bb07-b57b443006ac tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:20.741239 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-5bb807c9-7d2a-4344-bb07-b57b443006ac tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:20.750548 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-5bb807c9-7d2a-4344-bb07-b57b443006ac tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1359 microversion: 2.1 time: 0.154761 Aug 24 12:41:20.751126 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 473/949] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:20 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:41:21.772142 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-05d0dcfc-8a96-48a7-a733-74ee3c5858fa tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:21.772755 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-05d0dcfc-8a96-48a7-a733-74ee3c5858fa tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:21.779653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05d0dcfc-8a96-48a7-a733-74ee3c5858fa tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:21.780462 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05d0dcfc-8a96-48a7-a733-74ee3c5858fa tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:21.780897 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05d0dcfc-8a96-48a7-a733-74ee3c5858fa tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:21.781589 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05d0dcfc-8a96-48a7-a733-74ee3c5858fa tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:21.782040 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05d0dcfc-8a96-48a7-a733-74ee3c5858fa tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:21.782466 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-05d0dcfc-8a96-48a7-a733-74ee3c5858fa tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:21.921894 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-05d0dcfc-8a96-48a7-a733-74ee3c5858fa tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:21.929915 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-05d0dcfc-8a96-48a7-a733-74ee3c5858fa tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1359 microversion: 2.1 time: 0.161591 Aug 24 12:41:21.930816 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 477/950] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:21 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:22.951093 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-0b6c6723-0236-47b3-aeaa-26cbb39fcc11 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:22.952294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-0b6c6723-0236-47b3-aeaa-26cbb39fcc11 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:22.959695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0b6c6723-0236-47b3-aeaa-26cbb39fcc11 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:22.960477 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0b6c6723-0236-47b3-aeaa-26cbb39fcc11 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:22.961140 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0b6c6723-0236-47b3-aeaa-26cbb39fcc11 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:22.961968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0b6c6723-0236-47b3-aeaa-26cbb39fcc11 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:22.962510 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0b6c6723-0236-47b3-aeaa-26cbb39fcc11 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:22.962999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0b6c6723-0236-47b3-aeaa-26cbb39fcc11 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:23.178585 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-0b6c6723-0236-47b3-aeaa-26cbb39fcc11 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:23.187883 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-0b6c6723-0236-47b3-aeaa-26cbb39fcc11 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1359 microversion: 2.1 time: 0.241314 Aug 24 12:41:23.188457 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 474/951] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:22 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:24.210250 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0917694d-745b-42b9-adef-6619040a223f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:24.212034 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0917694d-745b-42b9-adef-6619040a223f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:24.219077 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0917694d-745b-42b9-adef-6619040a223f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:24.220378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0917694d-745b-42b9-adef-6619040a223f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:24.221293 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0917694d-745b-42b9-adef-6619040a223f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:24.222699 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0917694d-745b-42b9-adef-6619040a223f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:24.223373 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0917694d-745b-42b9-adef-6619040a223f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:24.223953 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0917694d-745b-42b9-adef-6619040a223f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:24.374143 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-0917694d-745b-42b9-adef-6619040a223f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:24.383999 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0917694d-745b-42b9-adef-6619040a223f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1359 microversion: 2.1 time: 0.177811 Aug 24 12:41:24.384709 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 478/952] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:24 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:25.406100 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e1c65bc3-a0a3-483c-9ed4-332d52d8aee7 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:25.407293 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e1c65bc3-a0a3-483c-9ed4-332d52d8aee7 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:25.414133 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e1c65bc3-a0a3-483c-9ed4-332d52d8aee7 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:25.414851 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e1c65bc3-a0a3-483c-9ed4-332d52d8aee7 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:25.415451 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e1c65bc3-a0a3-483c-9ed4-332d52d8aee7 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:25.416420 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e1c65bc3-a0a3-483c-9ed4-332d52d8aee7 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:25.417031 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e1c65bc3-a0a3-483c-9ed4-332d52d8aee7 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:25.417672 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e1c65bc3-a0a3-483c-9ed4-332d52d8aee7 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:25.588896 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-e1c65bc3-a0a3-483c-9ed4-332d52d8aee7 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:25.602169 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e1c65bc3-a0a3-483c-9ed4-332d52d8aee7 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1359 microversion: 2.1 time: 0.200638 Aug 24 12:41:25.603532 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 475/953] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:25 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:25.862554 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-b577ea52-88f4-48bb-9aaf-bc81fdb019b5 req-7c672fcb-8169-4692-b115-8863a076a4cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e9f003-88e1-43bb-8b20-9bb3c12bdb62", "name": "network-vif-plugged", "status": "completed", "tag": "7f1e74a4-26c6-4ea0-b25c-b771e422659e"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:25.882769 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b577ea52-88f4-48bb-9aaf-bc81fdb019b5 req-7c672fcb-8169-4692-b115-8863a076a4cc service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:25.883428 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b577ea52-88f4-48bb-9aaf-bc81fdb019b5 req-7c672fcb-8169-4692-b115-8863a076a4cc service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:25.883998 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-b577ea52-88f4-48bb-9aaf-bc81fdb019b5 req-7c672fcb-8169-4692-b115-8863a076a4cc service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:25.905963 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-b577ea52-88f4-48bb-9aaf-bc81fdb019b5 req-7c672fcb-8169-4692-b115-8863a076a4cc service nova] Creating event network-vif-plugged:7f1e74a4-26c6-4ea0-b25c-b771e422659e for instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 on hv-cinder-84890 Aug 24 12:41:25.915353 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-b577ea52-88f4-48bb-9aaf-bc81fdb019b5 req-7c672fcb-8169-4692-b115-8863a076a4cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053032 Aug 24 12:41:25.916787 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 479/954] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:41:26.624922 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-59575ab2-32a9-4de7-8cb6-42efc158b3d1 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:26.626268 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-59575ab2-32a9-4de7-8cb6-42efc158b3d1 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:26.633641 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59575ab2-32a9-4de7-8cb6-42efc158b3d1 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:26.634599 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59575ab2-32a9-4de7-8cb6-42efc158b3d1 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:26.635283 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59575ab2-32a9-4de7-8cb6-42efc158b3d1 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:26.637481 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59575ab2-32a9-4de7-8cb6-42efc158b3d1 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:26.638975 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59575ab2-32a9-4de7-8cb6-42efc158b3d1 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:26.640677 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-59575ab2-32a9-4de7-8cb6-42efc158b3d1 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:26.800282 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-59575ab2-32a9-4de7-8cb6-42efc158b3d1 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:26.811531 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-59575ab2-32a9-4de7-8cb6-42efc158b3d1 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1359 microversion: 2.1 time: 0.190954 Aug 24 12:41:26.812758 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 476/955] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:26 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:27.834565 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-7dcb9248-bfdb-4b4c-81a0-a404fcf41134 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:27.835922 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-7dcb9248-bfdb-4b4c-81a0-a404fcf41134 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:27.842354 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7dcb9248-bfdb-4b4c-81a0-a404fcf41134 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:27.843064 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7dcb9248-bfdb-4b4c-81a0-a404fcf41134 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:27.843744 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7dcb9248-bfdb-4b4c-81a0-a404fcf41134 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:27.844797 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7dcb9248-bfdb-4b4c-81a0-a404fcf41134 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:27.845427 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7dcb9248-bfdb-4b4c-81a0-a404fcf41134 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:27.846007 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7dcb9248-bfdb-4b4c-81a0-a404fcf41134 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:28.021251 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-7dcb9248-bfdb-4b4c-81a0-a404fcf41134 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:28.033337 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-7dcb9248-bfdb-4b4c-81a0-a404fcf41134 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1548 microversion: 2.1 time: 0.203475 Aug 24 12:41:28.035093 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 480/956] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:27 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1548 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:28.056621 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-651388c9-dc55-4618-ac0d-42b4e3fc396c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:28.057717 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-651388c9-dc55-4618-ac0d-42b4e3fc396c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:28.064675 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-651388c9-dc55-4618-ac0d-42b4e3fc396c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:28.065047 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-651388c9-dc55-4618-ac0d-42b4e3fc396c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:28.065475 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-651388c9-dc55-4618-ac0d-42b4e3fc396c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:28.066173 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-651388c9-dc55-4618-ac0d-42b4e3fc396c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:28.067090 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-651388c9-dc55-4618-ac0d-42b4e3fc396c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:28.067515 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-651388c9-dc55-4618-ac0d-42b4e3fc396c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:28.222820 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-651388c9-dc55-4618-ac0d-42b4e3fc396c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:28.230870 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-651388c9-dc55-4618-ac0d-42b4e3fc396c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1548 microversion: 2.1 time: 0.178944 Aug 24 12:41:28.232205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 477/957] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:28 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1548 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:28.251337 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0977326d-1fc1-428e-8a55-90a9446fa80f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:28.256032 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-0977326d-1fc1-428e-8a55-90a9446fa80f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:28.257104 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0977326d-1fc1-428e-8a55-90a9446fa80f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Searching by: {'deleted': False, 'project_id': '399ad86f3c61455bba626fd9e556e6e0'} {{(pid=127307) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 12:41:28.264727 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0977326d-1fc1-428e-8a55-90a9446fa80f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:28.265517 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0977326d-1fc1-428e-8a55-90a9446fa80f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:28.266179 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0977326d-1fc1-428e-8a55-90a9446fa80f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:28.267109 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0977326d-1fc1-428e-8a55-90a9446fa80f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:28.267824 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0977326d-1fc1-428e-8a55-90a9446fa80f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:28.268474 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0977326d-1fc1-428e-8a55-90a9446fa80f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:28.365741 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.multi_cell_list [None req-0977326d-1fc1-428e-8a55-90a9446fa80f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127307) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 12:41:28.462299 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0977326d-1fc1-428e-8a55-90a9446fa80f tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214616 Aug 24 12:41:28.463076 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 481/958] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 24 12:41:28 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:28.474125 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-621a0b3f-949e-4edf-b2f1-3575b529f71c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:28.474648 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-621a0b3f-949e-4edf-b2f1-3575b529f71c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:28.481966 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-621a0b3f-949e-4edf-b2f1-3575b529f71c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:28.482450 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-621a0b3f-949e-4edf-b2f1-3575b529f71c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:28.482878 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-621a0b3f-949e-4edf-b2f1-3575b529f71c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:28.484187 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-621a0b3f-949e-4edf-b2f1-3575b529f71c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:28.484187 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-621a0b3f-949e-4edf-b2f1-3575b529f71c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:28.484495 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-621a0b3f-949e-4edf-b2f1-3575b529f71c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:28.642277 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-621a0b3f-949e-4edf-b2f1-3575b529f71c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:28.651123 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-621a0b3f-949e-4edf-b2f1-3575b529f71c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1548 microversion: 2.1 time: 0.180744 Aug 24 12:41:28.651923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 478/959] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:28 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1548 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:30.425981 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-7634f869-b86e-4333-9079-fdd0633cd38a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0255f4a6-f49c-4965-9972-13546cd0e51a"}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:30.429174 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-7634f869-b86e-4333-9079-fdd0633cd38a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:30.437134 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7634f869-b86e-4333-9079-fdd0633cd38a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:30.438019 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7634f869-b86e-4333-9079-fdd0633cd38a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:30.438770 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7634f869-b86e-4333-9079-fdd0633cd38a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:30.440167 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7634f869-b86e-4333-9079-fdd0633cd38a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:30.441108 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7634f869-b86e-4333-9079-fdd0633cd38a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:30.441755 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-7634f869-b86e-4333-9079-fdd0633cd38a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:30.842288 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-7634f869-b86e-4333-9079-fdd0633cd38a tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "POST /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421232 Aug 24 12:41:30.843470 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 482/960] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 12:41:30 2022] POST /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/os-volume_attachments => generated 194 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:32.671148 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-67a34626-141d-4496-a09b-d31cd851e3bf tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Action: 'create', calling method: .version_select at 0x7f4696b5b430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1171590083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyElfOUWUqiolRJwcfXljXbjefaj1saizCfrHF00osD4FKgEJ4YxDhZJnhROBbbM+i1hZuOkHEq7QQ/DyMvMmJKSSNVuC7YzTERj4GUPa+Xavxpq94u4bXe9zceSfG8sA=="}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:32.687243 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-67a34626-141d-4496-a09b-d31cd851e3bf tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Getting quotas for project dcf72fd7c24f4691b49b142f53d81ea0. Resources: {'key_pairs'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:41:32.691219 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-67a34626-141d-4496-a09b-d31cd851e3bf tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Getting quotas for user bf01094f0a444f2396426866d134d222 and project dcf72fd7c24f4691b49b142f53d81ea0. Resources: {'key_pairs'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:41:32.716678 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-67a34626-141d-4496-a09b-d31cd851e3bf tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.255726 Aug 24 12:41:32.717352 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 479/961] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 12:41:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:38.565192 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6f9e72e7-f3b6-403f-83a3-4ef32eb05d16 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:38.565901 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-6f9e72e7-f3b6-403f-83a3-4ef32eb05d16 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:38.568471 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:38.569144 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:38.575184 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6f9e72e7-f3b6-403f-83a3-4ef32eb05d16 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:38.575702 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6f9e72e7-f3b6-403f-83a3-4ef32eb05d16 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:38.576144 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6f9e72e7-f3b6-403f-83a3-4ef32eb05d16 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:38.576848 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6f9e72e7-f3b6-403f-83a3-4ef32eb05d16 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:38.577295 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6f9e72e7-f3b6-403f-83a3-4ef32eb05d16 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:38.577721 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6f9e72e7-f3b6-403f-83a3-4ef32eb05d16 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:38.709276 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6f9e72e7-f3b6-403f-83a3-4ef32eb05d16 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:38.718367 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-6f9e72e7-f3b6-403f-83a3-4ef32eb05d16 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1594 microversion: 2.1 time: 0.157642 Aug 24 12:41:38.718928 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 483/962] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:38 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:40.556572 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=62 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:40.561125 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-32d8972b-79e3-40e4-82ff-b7aa371c9690 req-32771653-91d8-41f8-aca6-99f7ace33c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e9f003-88e1-43bb-8b20-9bb3c12bdb62", "tag": "7f1e74a4-26c6-4ea0-b25c-b771e422659e"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:40.565933 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:40.577257 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-32d8972b-79e3-40e4-82ff-b7aa371c9690 req-32771653-91d8-41f8-aca6-99f7ace33c60 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:40.578164 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-32d8972b-79e3-40e4-82ff-b7aa371c9690 req-32771653-91d8-41f8-aca6-99f7ace33c60 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:40.578812 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-32d8972b-79e3-40e4-82ff-b7aa371c9690 req-32771653-91d8-41f8-aca6-99f7ace33c60 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:40.591918 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-32d8972b-79e3-40e4-82ff-b7aa371c9690 req-32771653-91d8-41f8-aca6-99f7ace33c60 service nova] Creating event network-changed:7f1e74a4-26c6-4ea0-b25c-b771e422659e for instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 on hv-cinder-84890 Aug 24 12:41:40.597556 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-32d8972b-79e3-40e4-82ff-b7aa371c9690 req-32771653-91d8-41f8-aca6-99f7ace33c60 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042086 Aug 24 12:41:40.598859 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 480/963] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:42.128907 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b5ab3045-f7ff-42ee-b2de-6c0daf4798d3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1324348453"}} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:42.129437 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-b5ab3045-f7ff-42ee-b2de-6c0daf4798d3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:42.135979 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b5ab3045-f7ff-42ee-b2de-6c0daf4798d3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:42.136461 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b5ab3045-f7ff-42ee-b2de-6c0daf4798d3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:42.136892 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b5ab3045-f7ff-42ee-b2de-6c0daf4798d3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:42.137579 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b5ab3045-f7ff-42ee-b2de-6c0daf4798d3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:42.138034 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b5ab3045-f7ff-42ee-b2de-6c0daf4798d3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:42.138455 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b5ab3045-f7ff-42ee-b2de-6c0daf4798d3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:42.140800 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:42.276432 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.network.security_group_api [None req-b5ab3045-f7ff-42ee-b2de-6c0daf4798d3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Adding security group b0f13c08-1252-497d-9be6-3e20386dae88 to port 7f1e74a4-26c6-4ea0-b25c-b771e422659e Aug 24 12:41:42.604793 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b5ab3045-f7ff-42ee-b2de-6c0daf4798d3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "POST /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/action" status: 202 len: 0 microversion: 2.1 time: 0.479987 Aug 24 12:41:42.608968 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 484/964] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 12:41:42 2022] POST /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:41:42.615373 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-31b2af3d-5f1f-47ce-b1c7-fdb15434cf98 req-ebcfd539-72d2-442c-9b43-551dad32a4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e9f003-88e1-43bb-8b20-9bb3c12bdb62", "tag": "7f1e74a4-26c6-4ea0-b25c-b771e422659e"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:42.624664 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-5199525d-8d80-4205-9854-39d0f37a128b tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:42.626511 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-5199525d-8d80-4205-9854-39d0f37a128b tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:42.639665 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-31b2af3d-5f1f-47ce-b1c7-fdb15434cf98 req-ebcfd539-72d2-442c-9b43-551dad32a4e6 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:42.641463 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5199525d-8d80-4205-9854-39d0f37a128b tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:42.642082 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5199525d-8d80-4205-9854-39d0f37a128b tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:42.642678 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-31b2af3d-5f1f-47ce-b1c7-fdb15434cf98 req-ebcfd539-72d2-442c-9b43-551dad32a4e6 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:42.643386 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5199525d-8d80-4205-9854-39d0f37a128b tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:42.643811 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-31b2af3d-5f1f-47ce-b1c7-fdb15434cf98 req-ebcfd539-72d2-442c-9b43-551dad32a4e6 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:42.644484 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5199525d-8d80-4205-9854-39d0f37a128b tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:42.649177 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5199525d-8d80-4205-9854-39d0f37a128b tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:42.649871 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-5199525d-8d80-4205-9854-39d0f37a128b tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:42.669202 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-31b2af3d-5f1f-47ce-b1c7-fdb15434cf98 req-ebcfd539-72d2-442c-9b43-551dad32a4e6 service nova] Creating event network-changed:7f1e74a4-26c6-4ea0-b25c-b771e422659e for instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 on hv-cinder-84890 Aug 24 12:41:42.679412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-31b2af3d-5f1f-47ce-b1c7-fdb15434cf98 req-ebcfd539-72d2-442c-9b43-551dad32a4e6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070122 Aug 24 12:41:42.684144 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 481/965] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:41:42.844692 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-5199525d-8d80-4205-9854-39d0f37a128b tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:42.854524 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-5199525d-8d80-4205-9854-39d0f37a128b tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1760 microversion: 2.1 time: 0.237425 Aug 24 12:41:42.856784 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 485/966] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:42 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1760 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:48.035793 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=4 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:48.040531 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2093026963", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1171590083", "security_groups": [{"name": "tempest-secgroup-smoke-1289421627"}], "networks": [{"uuid": "0822cd9f-efce-41be-b3a5-74d4877d22c6"}], "block_device_mapping_v2": [{"uuid": "4addea57-d289-4a6b-aff6-0b7c27031900", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:48.153680 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.network.neutron [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] validate_networks() for [('0822cd9f-efce-41be-b3a5-74d4877d22c6', None, None, None, None, None)] {{(pid=127308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:41:48.753734 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Flavor limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:41:48.754193 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Image limits 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:41:48.754670 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Flavor pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:41:48.755154 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Image pref 0:0:0 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:41:48.755570 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.virt.hardware [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:41:48.764665 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:48.765143 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:48.765576 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:48.766302 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:48.766756 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:48.767177 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:48.784193 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Getting quotas for project dcf72fd7c24f4691b49b142f53d81ea0. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:41:48.788210 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.quota [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Getting quotas for user bf01094f0a444f2396426866d134d222 and project dcf72fd7c24f4691b49b142f53d81ea0. Resources: {'cores', 'instances', 'ram'} {{(pid=127308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:41:48.846231 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Going to run 1 instances... {{(pid=127308) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:41:48.848923 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4addea57-d289-4a6b-aff6-0b7c27031900',volume_size=None,volume_type=None)] {{(pid=127308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:41:48.983204 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e127fce9-bac0-4dc1-b060-b868444296e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.948247 Aug 24 12:41:48.983875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 482/967] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 12:41:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:41:48.994438 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-488b7ca1-0ee0-4891-81a2-ad7c2c88f915 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:48.995206 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-488b7ca1-0ee0-4891-81a2-ad7c2c88f915 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:49.049973 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-488b7ca1-0ee0-4891-81a2-ad7c2c88f915 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:49.056660 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-488b7ca1-0ee0-4891-81a2-ad7c2c88f915 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1089 microversion: 2.1 time: 0.066056 Aug 24 12:41:49.057221 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 486/968] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:48 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:50.077142 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4034ab5b-1a36-4124-b0da-d2def0ae6231 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:50.077945 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4034ab5b-1a36-4124-b0da-d2def0ae6231 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:50.084822 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4034ab5b-1a36-4124-b0da-d2def0ae6231 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:50.085416 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4034ab5b-1a36-4124-b0da-d2def0ae6231 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:50.085776 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4034ab5b-1a36-4124-b0da-d2def0ae6231 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:50.086467 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4034ab5b-1a36-4124-b0da-d2def0ae6231 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:50.086915 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4034ab5b-1a36-4124-b0da-d2def0ae6231 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:50.087338 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4034ab5b-1a36-4124-b0da-d2def0ae6231 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:50.157100 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4034ab5b-1a36-4124-b0da-d2def0ae6231 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:50.165472 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4034ab5b-1a36-4124-b0da-d2def0ae6231 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1205 microversion: 2.1 time: 0.093202 Aug 24 12:41:50.166036 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 483/969] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:50 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1205 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:51.186343 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b4e5af07-04dd-4c7e-a42d-569978d625cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:51.187171 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-b4e5af07-04dd-4c7e-a42d-569978d625cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:51.194313 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b4e5af07-04dd-4c7e-a42d-569978d625cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:51.194803 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b4e5af07-04dd-4c7e-a42d-569978d625cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:51.195232 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b4e5af07-04dd-4c7e-a42d-569978d625cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:51.195950 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b4e5af07-04dd-4c7e-a42d-569978d625cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:51.196400 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b4e5af07-04dd-4c7e-a42d-569978d625cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:51.196816 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b4e5af07-04dd-4c7e-a42d-569978d625cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:51.328763 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-0dc89620-7123-40f7-b936-377b9dcfd384 req-919b9847-d433-46df-bb83-89c5ed1df6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6803e92-5e64-4ecb-b624-22116193110f", "tag": "91b08ae0-4c7e-4b5c-a0d3-b2cf3d03197d"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:51.338146 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b4e5af07-04dd-4c7e-a42d-569978d625cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:51.341317 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-0dc89620-7123-40f7-b936-377b9dcfd384 req-919b9847-d433-46df-bb83-89c5ed1df6b6 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:51.342057 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-0dc89620-7123-40f7-b936-377b9dcfd384 req-919b9847-d433-46df-bb83-89c5ed1df6b6 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:51.342590 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-0dc89620-7123-40f7-b936-377b9dcfd384 req-919b9847-d433-46df-bb83-89c5ed1df6b6 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:51.356283 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-0dc89620-7123-40f7-b936-377b9dcfd384 req-919b9847-d433-46df-bb83-89c5ed1df6b6 service nova] Creating event network-changed:91b08ae0-4c7e-4b5c-a0d3-b2cf3d03197d for instance f6803e92-5e64-4ecb-b624-22116193110f on hv-cinder-84890 Aug 24 12:41:51.361111 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b4e5af07-04dd-4c7e-a42d-569978d625cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1261 microversion: 2.1 time: 0.177874 Aug 24 12:41:51.361957 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 487/970] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:51 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:51.362439 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-0dc89620-7123-40f7-b936-377b9dcfd384 req-919b9847-d433-46df-bb83-89c5ed1df6b6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039389 Aug 24 12:41:51.363200 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 484/971] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:52.382302 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f7dab369-1c7b-4f72-9332-2af52645e16e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:52.382915 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f7dab369-1c7b-4f72-9332-2af52645e16e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:52.390095 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f7dab369-1c7b-4f72-9332-2af52645e16e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:52.390583 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f7dab369-1c7b-4f72-9332-2af52645e16e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:52.391016 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f7dab369-1c7b-4f72-9332-2af52645e16e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:52.391743 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f7dab369-1c7b-4f72-9332-2af52645e16e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:52.392197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f7dab369-1c7b-4f72-9332-2af52645e16e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:52.392619 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f7dab369-1c7b-4f72-9332-2af52645e16e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:52.529788 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f7dab369-1c7b-4f72-9332-2af52645e16e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:52.537459 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f7dab369-1c7b-4f72-9332-2af52645e16e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1261 microversion: 2.1 time: 0.159027 Aug 24 12:41:52.538003 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 488/972] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:52 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:53.559253 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-73d93388-6bd3-446d-81e7-7c41d253f8e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:53.559985 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-73d93388-6bd3-446d-81e7-7c41d253f8e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:53.566635 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-73d93388-6bd3-446d-81e7-7c41d253f8e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:53.567125 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-73d93388-6bd3-446d-81e7-7c41d253f8e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:53.567644 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-73d93388-6bd3-446d-81e7-7c41d253f8e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:53.568411 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-73d93388-6bd3-446d-81e7-7c41d253f8e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:53.568870 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-73d93388-6bd3-446d-81e7-7c41d253f8e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:53.569302 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-73d93388-6bd3-446d-81e7-7c41d253f8e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:53.705399 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-73d93388-6bd3-446d-81e7-7c41d253f8e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:53.712932 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-73d93388-6bd3-446d-81e7-7c41d253f8e0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1261 microversion: 2.1 time: 0.158438 Aug 24 12:41:53.713613 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 485/973] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:53 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:54.733657 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-831cafb0-05a7-4d40-a052-90054da80ef5 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:54.734264 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-831cafb0-05a7-4d40-a052-90054da80ef5 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:54.740617 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-831cafb0-05a7-4d40-a052-90054da80ef5 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:54.741108 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-831cafb0-05a7-4d40-a052-90054da80ef5 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:54.741543 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-831cafb0-05a7-4d40-a052-90054da80ef5 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:54.742228 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-831cafb0-05a7-4d40-a052-90054da80ef5 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:54.742681 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-831cafb0-05a7-4d40-a052-90054da80ef5 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:54.743102 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-831cafb0-05a7-4d40-a052-90054da80ef5 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:54.871668 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-831cafb0-05a7-4d40-a052-90054da80ef5 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:54.879498 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-831cafb0-05a7-4d40-a052-90054da80ef5 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1261 microversion: 2.1 time: 0.150176 Aug 24 12:41:54.880285 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 489/974] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:54 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:55.900319 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ccbf72df-9633-4340-a19d-ea291875e8d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:55.900859 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-ccbf72df-9633-4340-a19d-ea291875e8d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:55.907709 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ccbf72df-9633-4340-a19d-ea291875e8d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:55.908199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ccbf72df-9633-4340-a19d-ea291875e8d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:55.908628 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ccbf72df-9633-4340-a19d-ea291875e8d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:55.909329 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ccbf72df-9633-4340-a19d-ea291875e8d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:55.909780 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ccbf72df-9633-4340-a19d-ea291875e8d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:55.910199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ccbf72df-9633-4340-a19d-ea291875e8d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:56.044447 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-ccbf72df-9633-4340-a19d-ea291875e8d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:56.052069 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-ccbf72df-9633-4340-a19d-ea291875e8d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1261 microversion: 2.1 time: 0.155677 Aug 24 12:41:56.052624 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 486/975] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:55 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:57.072285 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-648f1731-3fda-4c1b-9fe6-b71559e5c11c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:57.072887 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-648f1731-3fda-4c1b-9fe6-b71559e5c11c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:57.079869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-648f1731-3fda-4c1b-9fe6-b71559e5c11c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:57.080353 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-648f1731-3fda-4c1b-9fe6-b71559e5c11c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:57.080782 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-648f1731-3fda-4c1b-9fe6-b71559e5c11c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:57.081467 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-648f1731-3fda-4c1b-9fe6-b71559e5c11c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:57.081917 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-648f1731-3fda-4c1b-9fe6-b71559e5c11c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:57.082358 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-648f1731-3fda-4c1b-9fe6-b71559e5c11c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:57.211186 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-648f1731-3fda-4c1b-9fe6-b71559e5c11c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:57.218957 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-648f1731-3fda-4c1b-9fe6-b71559e5c11c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1261 microversion: 2.1 time: 0.150436 Aug 24 12:41:57.219490 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 490/976] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:57 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:58.239789 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-da26c9f7-866c-4628-b089-4410ed6bbc3f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:58.240375 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-da26c9f7-866c-4628-b089-4410ed6bbc3f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:58.247350 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da26c9f7-866c-4628-b089-4410ed6bbc3f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:58.247854 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da26c9f7-866c-4628-b089-4410ed6bbc3f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:58.248288 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da26c9f7-866c-4628-b089-4410ed6bbc3f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:58.248962 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da26c9f7-866c-4628-b089-4410ed6bbc3f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:58.249406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da26c9f7-866c-4628-b089-4410ed6bbc3f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:58.249820 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-da26c9f7-866c-4628-b089-4410ed6bbc3f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:58.378164 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-da26c9f7-866c-4628-b089-4410ed6bbc3f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:58.385797 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-da26c9f7-866c-4628-b089-4410ed6bbc3f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1261 microversion: 2.1 time: 0.149833 Aug 24 12:41:58.386452 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 487/977] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:58 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:59.406595 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8052728d-f3a5-4208-97d9-30a123cb938f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:59.407197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8052728d-f3a5-4208-97d9-30a123cb938f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:59.409518 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell0:SELECT=2 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:59.414819 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8052728d-f3a5-4208-97d9-30a123cb938f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:59.415297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8052728d-f3a5-4208-97d9-30a123cb938f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:59.415756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8052728d-f3a5-4208-97d9-30a123cb938f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:59.416437 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8052728d-f3a5-4208-97d9-30a123cb938f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:59.417450 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8052728d-f3a5-4208-97d9-30a123cb938f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:59.417942 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8052728d-f3a5-4208-97d9-30a123cb938f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:59.550942 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8052728d-f3a5-4208-97d9-30a123cb938f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:59.559321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8052728d-f3a5-4208-97d9-30a123cb938f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1261 microversion: 2.1 time: 0.156529 Aug 24 12:41:59.559937 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 491/978] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:59 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:42:00.581836 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-0259d35c-c23b-45ce-abcd-b4ee199467af tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:00.582640 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-0259d35c-c23b-45ce-abcd-b4ee199467af tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:00.584868 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:00.585560 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell0:SELECT=6 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:00.592121 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0259d35c-c23b-45ce-abcd-b4ee199467af tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:00.592606 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0259d35c-c23b-45ce-abcd-b4ee199467af tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:00.593044 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0259d35c-c23b-45ce-abcd-b4ee199467af tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:00.593738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0259d35c-c23b-45ce-abcd-b4ee199467af tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:00.594194 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0259d35c-c23b-45ce-abcd-b4ee199467af tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:00.594617 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0259d35c-c23b-45ce-abcd-b4ee199467af tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:00.727563 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-0259d35c-c23b-45ce-abcd-b4ee199467af tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:00.735395 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-0259d35c-c23b-45ce-abcd-b4ee199467af tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1261 microversion: 2.1 time: 0.158638 Aug 24 12:42:00.735986 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 488/979] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:00 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:01.733048 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-85c09470-fd7d-4a7b-80cc-7ab589d2a7af req-97f4879b-c2f9-44cc-8f66-ea413a85f312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6803e92-5e64-4ecb-b624-22116193110f", "name": "network-vif-plugged", "status": "completed", "tag": "91b08ae0-4c7e-4b5c-a0d3-b2cf3d03197d"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:42:01.744356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-85c09470-fd7d-4a7b-80cc-7ab589d2a7af req-97f4879b-c2f9-44cc-8f66-ea413a85f312 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:01.744935 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-85c09470-fd7d-4a7b-80cc-7ab589d2a7af req-97f4879b-c2f9-44cc-8f66-ea413a85f312 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:01.745498 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-85c09470-fd7d-4a7b-80cc-7ab589d2a7af req-97f4879b-c2f9-44cc-8f66-ea413a85f312 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:01.756842 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d682bd2e-91d4-4e61-9752-05d0e5104ea1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:01.758169 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d682bd2e-91d4-4e61-9752-05d0e5104ea1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:01.762141 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-85c09470-fd7d-4a7b-80cc-7ab589d2a7af req-97f4879b-c2f9-44cc-8f66-ea413a85f312 service nova] Creating event network-vif-plugged:91b08ae0-4c7e-4b5c-a0d3-b2cf3d03197d for instance f6803e92-5e64-4ecb-b624-22116193110f on hv-cinder-84890 Aug 24 12:42:01.766970 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-85c09470-fd7d-4a7b-80cc-7ab589d2a7af req-97f4879b-c2f9-44cc-8f66-ea413a85f312 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037900 Aug 24 12:42:01.767546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d682bd2e-91d4-4e61-9752-05d0e5104ea1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:01.767722 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 492/980] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:01.768408 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d682bd2e-91d4-4e61-9752-05d0e5104ea1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:01.769054 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d682bd2e-91d4-4e61-9752-05d0e5104ea1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:01.769776 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d682bd2e-91d4-4e61-9752-05d0e5104ea1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:01.770435 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d682bd2e-91d4-4e61-9752-05d0e5104ea1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:01.770990 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d682bd2e-91d4-4e61-9752-05d0e5104ea1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:01.910519 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d682bd2e-91d4-4e61-9752-05d0e5104ea1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:01.919770 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d682bd2e-91d4-4e61-9752-05d0e5104ea1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1261 microversion: 2.1 time: 0.167080 Aug 24 12:42:01.920333 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 489/981] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:01 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:42:02.942010 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6aeffbbe-fd1b-4bed-8650-f9589acac9a0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:02.942700 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-6aeffbbe-fd1b-4bed-8650-f9589acac9a0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:02.949818 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6aeffbbe-fd1b-4bed-8650-f9589acac9a0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:02.950297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6aeffbbe-fd1b-4bed-8650-f9589acac9a0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:02.950724 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6aeffbbe-fd1b-4bed-8650-f9589acac9a0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:02.951399 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6aeffbbe-fd1b-4bed-8650-f9589acac9a0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:02.951870 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6aeffbbe-fd1b-4bed-8650-f9589acac9a0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:02.952289 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6aeffbbe-fd1b-4bed-8650-f9589acac9a0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:03.086778 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6aeffbbe-fd1b-4bed-8650-f9589acac9a0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:03.094902 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-6aeffbbe-fd1b-4bed-8650-f9589acac9a0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1261 microversion: 2.1 time: 0.157492 Aug 24 12:42:03.095539 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 493/982] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:02 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:04.116104 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-831e29bd-c77f-458d-9463-cd0dea28f266 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:04.116708 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-831e29bd-c77f-458d-9463-cd0dea28f266 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:04.123139 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-831e29bd-c77f-458d-9463-cd0dea28f266 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:04.123609 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-831e29bd-c77f-458d-9463-cd0dea28f266 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:04.124067 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-831e29bd-c77f-458d-9463-cd0dea28f266 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:04.124739 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-831e29bd-c77f-458d-9463-cd0dea28f266 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:04.125213 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-831e29bd-c77f-458d-9463-cd0dea28f266 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:04.125624 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-831e29bd-c77f-458d-9463-cd0dea28f266 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:04.262753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-831e29bd-c77f-458d-9463-cd0dea28f266 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:04.270393 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-831e29bd-c77f-458d-9463-cd0dea28f266 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1445 microversion: 2.1 time: 0.158279 Aug 24 12:42:04.270941 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 490/983] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:04 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:04.289801 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-96da3db2-81a7-48c9-bdce-f1f20aa25344 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:04.290438 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-96da3db2-81a7-48c9-bdce-f1f20aa25344 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:04.296831 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-96da3db2-81a7-48c9-bdce-f1f20aa25344 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:04.297310 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-96da3db2-81a7-48c9-bdce-f1f20aa25344 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:04.297742 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-96da3db2-81a7-48c9-bdce-f1f20aa25344 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:04.298430 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-96da3db2-81a7-48c9-bdce-f1f20aa25344 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:04.298903 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-96da3db2-81a7-48c9-bdce-f1f20aa25344 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:04.299307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-96da3db2-81a7-48c9-bdce-f1f20aa25344 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:04.430710 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-96da3db2-81a7-48c9-bdce-f1f20aa25344 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:04.438576 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-96da3db2-81a7-48c9-bdce-f1f20aa25344 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1445 microversion: 2.1 time: 0.152603 Aug 24 12:42:04.439141 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 494/984] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:04 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:06.235324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f1e459ea-f59a-4bc0-8eb7-8445a8f95eff tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:42:06.238181 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f1e459ea-f59a-4bc0-8eb7-8445a8f95eff tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:06.245366 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1e459ea-f59a-4bc0-8eb7-8445a8f95eff tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:06.246108 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1e459ea-f59a-4bc0-8eb7-8445a8f95eff tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:06.246394 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1e459ea-f59a-4bc0-8eb7-8445a8f95eff tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:06.247259 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1e459ea-f59a-4bc0-8eb7-8445a8f95eff tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:06.247541 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1e459ea-f59a-4bc0-8eb7-8445a8f95eff tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:06.247990 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f1e459ea-f59a-4bc0-8eb7-8445a8f95eff tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:06.287219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-21203ae0-c855-4a8b-a4ab-2eca41b62335 req-3bf74dd7-b1ba-494c-99f2-1b4a1e07fca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6803e92-5e64-4ecb-b624-22116193110f", "tag": "91b08ae0-4c7e-4b5c-a0d3-b2cf3d03197d"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:42:06.296836 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-21203ae0-c855-4a8b-a4ab-2eca41b62335 req-3bf74dd7-b1ba-494c-99f2-1b4a1e07fca0 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:06.297310 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-21203ae0-c855-4a8b-a4ab-2eca41b62335 req-3bf74dd7-b1ba-494c-99f2-1b4a1e07fca0 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:06.297955 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-21203ae0-c855-4a8b-a4ab-2eca41b62335 req-3bf74dd7-b1ba-494c-99f2-1b4a1e07fca0 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:06.310659 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-21203ae0-c855-4a8b-a4ab-2eca41b62335 req-3bf74dd7-b1ba-494c-99f2-1b4a1e07fca0 service nova] Creating event network-changed:91b08ae0-4c7e-4b5c-a0d3-b2cf3d03197d for instance f6803e92-5e64-4ecb-b624-22116193110f on hv-cinder-84890 Aug 24 12:42:06.318317 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-21203ae0-c855-4a8b-a4ab-2eca41b62335 req-3bf74dd7-b1ba-494c-99f2-1b4a1e07fca0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034546 Aug 24 12:42:06.319644 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 495/985] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:06.330153 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f1e459ea-f59a-4bc0-8eb7-8445a8f95eff tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "POST /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/action" status: 202 len: 0 microversion: 2.1 time: 0.099193 Aug 24 12:42:06.331085 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 491/986] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 12:42:06 2022] POST /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:42:06.347509 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-597a7267-f600-4cff-a1bb-d49e231187bf tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:06.348085 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-597a7267-f600-4cff-a1bb-d49e231187bf tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:06.356170 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-597a7267-f600-4cff-a1bb-d49e231187bf tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:06.356667 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-597a7267-f600-4cff-a1bb-d49e231187bf tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:06.358356 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-597a7267-f600-4cff-a1bb-d49e231187bf tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:06.359070 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-597a7267-f600-4cff-a1bb-d49e231187bf tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:06.359811 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-597a7267-f600-4cff-a1bb-d49e231187bf tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:06.360260 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-597a7267-f600-4cff-a1bb-d49e231187bf tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:06.619533 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-597a7267-f600-4cff-a1bb-d49e231187bf tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:06.635660 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-597a7267-f600-4cff-a1bb-d49e231187bf tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1752 microversion: 2.1 time: 0.294221 Aug 24 12:42:06.636649 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 496/987] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:06 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1752 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:07.658356 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-a338fdd3-d29e-42fc-ac38-5a42019d2f25 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:07.659049 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-a338fdd3-d29e-42fc-ac38-5a42019d2f25 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:07.665158 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a338fdd3-d29e-42fc-ac38-5a42019d2f25 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:07.665636 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a338fdd3-d29e-42fc-ac38-5a42019d2f25 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:07.666064 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a338fdd3-d29e-42fc-ac38-5a42019d2f25 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:07.667322 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a338fdd3-d29e-42fc-ac38-5a42019d2f25 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:07.667925 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a338fdd3-d29e-42fc-ac38-5a42019d2f25 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:07.668519 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-a338fdd3-d29e-42fc-ac38-5a42019d2f25 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:07.812634 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-a338fdd3-d29e-42fc-ac38-5a42019d2f25 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:07.820957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-a338fdd3-d29e-42fc-ac38-5a42019d2f25 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.167473 Aug 24 12:42:07.821518 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 492/988] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:07 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:08.841883 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-76981a86-e1f8-4aa4-af80-357cc599f539 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:08.842500 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-76981a86-e1f8-4aa4-af80-357cc599f539 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:08.844929 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=30 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:08.850113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76981a86-e1f8-4aa4-af80-357cc599f539 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:08.850600 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76981a86-e1f8-4aa4-af80-357cc599f539 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:08.851041 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76981a86-e1f8-4aa4-af80-357cc599f539 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:08.851774 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76981a86-e1f8-4aa4-af80-357cc599f539 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:08.852230 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76981a86-e1f8-4aa4-af80-357cc599f539 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:08.852656 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-76981a86-e1f8-4aa4-af80-357cc599f539 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:08.992597 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-76981a86-e1f8-4aa4-af80-357cc599f539 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:09.001530 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-76981a86-e1f8-4aa4-af80-357cc599f539 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.163471 Aug 24 12:42:09.002100 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 497/989] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:08 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:10.023997 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d01b532f-6e5b-4cce-a314-99392254095e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:10.024531 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d01b532f-6e5b-4cce-a314-99392254095e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:10.031655 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d01b532f-6e5b-4cce-a314-99392254095e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:10.032142 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d01b532f-6e5b-4cce-a314-99392254095e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:10.032576 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d01b532f-6e5b-4cce-a314-99392254095e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:10.033260 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d01b532f-6e5b-4cce-a314-99392254095e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:10.033711 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d01b532f-6e5b-4cce-a314-99392254095e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:10.034153 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d01b532f-6e5b-4cce-a314-99392254095e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:10.181026 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d01b532f-6e5b-4cce-a314-99392254095e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:10.189905 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d01b532f-6e5b-4cce-a314-99392254095e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.169856 Aug 24 12:42:10.190461 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 493/990] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:10 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:11.211932 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-85b32018-a760-4b6e-ad5e-ed3f9cd434af tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:11.212547 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-85b32018-a760-4b6e-ad5e-ed3f9cd434af tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:11.219804 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85b32018-a760-4b6e-ad5e-ed3f9cd434af tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:11.220293 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85b32018-a760-4b6e-ad5e-ed3f9cd434af tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:11.220734 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85b32018-a760-4b6e-ad5e-ed3f9cd434af tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:11.221438 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85b32018-a760-4b6e-ad5e-ed3f9cd434af tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:11.222225 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85b32018-a760-4b6e-ad5e-ed3f9cd434af tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:11.222313 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85b32018-a760-4b6e-ad5e-ed3f9cd434af tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:11.368274 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-85b32018-a760-4b6e-ad5e-ed3f9cd434af tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:11.376472 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-85b32018-a760-4b6e-ad5e-ed3f9cd434af tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.168494 Aug 24 12:42:11.377046 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 498/991] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:11 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:11.636671 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-482a1570-94b2-4054-9138-71d8df696237 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:11.637349 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-482a1570-94b2-4054-9138-71d8df696237 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:11.639266 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-97df23d0-18c9-4492-ab0e-64d3376efed8 req-0fd083f4-9bd4-4e1a-bd9c-ef88af0d500d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7", "tag": "154fd828-a0ba-4052-8d11-2881dad1d6e5"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:42:11.640085 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:11.645636 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-482a1570-94b2-4054-9138-71d8df696237 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:11.646135 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-482a1570-94b2-4054-9138-71d8df696237 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:11.646607 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-482a1570-94b2-4054-9138-71d8df696237 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:11.647489 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-482a1570-94b2-4054-9138-71d8df696237 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:11.647982 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-482a1570-94b2-4054-9138-71d8df696237 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:11.648410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-482a1570-94b2-4054-9138-71d8df696237 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:11.649894 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-97df23d0-18c9-4492-ab0e-64d3376efed8 req-0fd083f4-9bd4-4e1a-bd9c-ef88af0d500d service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:11.650440 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-97df23d0-18c9-4492-ab0e-64d3376efed8 req-0fd083f4-9bd4-4e1a-bd9c-ef88af0d500d service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:11.651004 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-97df23d0-18c9-4492-ab0e-64d3376efed8 req-0fd083f4-9bd4-4e1a-bd9c-ef88af0d500d service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:11.665366 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-97df23d0-18c9-4492-ab0e-64d3376efed8 req-0fd083f4-9bd4-4e1a-bd9c-ef88af0d500d service nova] Creating event network-changed:154fd828-a0ba-4052-8d11-2881dad1d6e5 for instance dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 on hv-cinder-84890 Aug 24 12:42:11.671612 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-97df23d0-18c9-4492-ab0e-64d3376efed8 req-0fd083f4-9bd4-4e1a-bd9c-ef88af0d500d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036213 Aug 24 12:42:11.672498 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 499/992] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:11.672683 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:11.680811 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-482a1570-94b2-4054-9138-71d8df696237 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Going to try to terminate instance {{(pid=127308) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:42:11.768530 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-482a1570-94b2-4054-9138-71d8df696237 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 204 len: 0 microversion: 2.1 time: 0.135504 Aug 24 12:42:11.769304 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 494/993] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:42:11 2022] DELETE /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:42:11.778683 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-192645d4-b4fb-49f9-95c4-bee1a2645520 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:11.779519 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-192645d4-b4fb-49f9-95c4-bee1a2645520 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:11.786058 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-192645d4-b4fb-49f9-95c4-bee1a2645520 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:11.786586 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-192645d4-b4fb-49f9-95c4-bee1a2645520 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:11.787027 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-192645d4-b4fb-49f9-95c4-bee1a2645520 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:11.787758 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-192645d4-b4fb-49f9-95c4-bee1a2645520 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:11.788219 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-192645d4-b4fb-49f9-95c4-bee1a2645520 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:11.788643 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-192645d4-b4fb-49f9-95c4-bee1a2645520 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:11.944066 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-192645d4-b4fb-49f9-95c4-bee1a2645520 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:11.952572 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-192645d4-b4fb-49f9-95c4-bee1a2645520 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1578 microversion: 2.1 time: 0.179051 Aug 24 12:42:11.953140 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 500/994] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:11 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:42:12.398808 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2b69b4a6-bdc2-45ff-a191-b0bcf63f31ed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:12.399514 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2b69b4a6-bdc2-45ff-a191-b0bcf63f31ed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:12.405646 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2b69b4a6-bdc2-45ff-a191-b0bcf63f31ed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:12.406131 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2b69b4a6-bdc2-45ff-a191-b0bcf63f31ed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:12.406565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2b69b4a6-bdc2-45ff-a191-b0bcf63f31ed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:12.407259 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2b69b4a6-bdc2-45ff-a191-b0bcf63f31ed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:12.407738 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2b69b4a6-bdc2-45ff-a191-b0bcf63f31ed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:12.408195 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2b69b4a6-bdc2-45ff-a191-b0bcf63f31ed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:12.559105 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-2b69b4a6-bdc2-45ff-a191-b0bcf63f31ed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:12.568070 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2b69b4a6-bdc2-45ff-a191-b0bcf63f31ed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.173398 Aug 24 12:42:12.568750 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 495/995] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:12 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:12.974171 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-ec51cda5-ec32-4baf-b04b-05c75ce8588b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:12.974791 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-ec51cda5-ec32-4baf-b04b-05c75ce8588b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:12.981196 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ec51cda5-ec32-4baf-b04b-05c75ce8588b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:12.981682 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ec51cda5-ec32-4baf-b04b-05c75ce8588b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:12.982116 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ec51cda5-ec32-4baf-b04b-05c75ce8588b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:12.982803 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ec51cda5-ec32-4baf-b04b-05c75ce8588b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:12.983257 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ec51cda5-ec32-4baf-b04b-05c75ce8588b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:12.983715 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-ec51cda5-ec32-4baf-b04b-05c75ce8588b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:12.987670 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=82 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:13.187581 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-ec51cda5-ec32-4baf-b04b-05c75ce8588b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:13.195984 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-ec51cda5-ec32-4baf-b04b-05c75ce8588b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1578 microversion: 2.1 time: 0.225574 Aug 24 12:42:13.196638 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 501/996] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:12 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:13.589775 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1050313a-ece9-4f0d-a099-bfdec16728a3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:13.590516 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1050313a-ece9-4f0d-a099-bfdec16728a3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:13.597032 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1050313a-ece9-4f0d-a099-bfdec16728a3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:13.597596 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1050313a-ece9-4f0d-a099-bfdec16728a3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:13.598100 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1050313a-ece9-4f0d-a099-bfdec16728a3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:13.598810 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1050313a-ece9-4f0d-a099-bfdec16728a3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:13.599247 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1050313a-ece9-4f0d-a099-bfdec16728a3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:13.599686 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1050313a-ece9-4f0d-a099-bfdec16728a3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:13.759105 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-1050313a-ece9-4f0d-a099-bfdec16728a3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:13.767688 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1050313a-ece9-4f0d-a099-bfdec16728a3 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.181681 Aug 24 12:42:13.768263 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 496/997] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:13 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:13.797326 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-2a476899-6cb9-4bb3-b893-0205bd7dd028 req-c94039e0-6844-4b1c-ae0f-f1488c9085e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7", "name": "network-vif-deleted", "tag": "154fd828-a0ba-4052-8d11-2881dad1d6e5"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:42:13.806691 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-2a476899-6cb9-4bb3-b893-0205bd7dd028 req-c94039e0-6844-4b1c-ae0f-f1488c9085e1 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:13.807941 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-2a476899-6cb9-4bb3-b893-0205bd7dd028 req-c94039e0-6844-4b1c-ae0f-f1488c9085e1 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:13.808423 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-2a476899-6cb9-4bb3-b893-0205bd7dd028 req-c94039e0-6844-4b1c-ae0f-f1488c9085e1 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:13.819459 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-2a476899-6cb9-4bb3-b893-0205bd7dd028 req-c94039e0-6844-4b1c-ae0f-f1488c9085e1 service nova] Creating event network-vif-deleted:154fd828-a0ba-4052-8d11-2881dad1d6e5 for instance dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 on hv-cinder-84890 Aug 24 12:42:13.824537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-2a476899-6cb9-4bb3-b893-0205bd7dd028 req-c94039e0-6844-4b1c-ae0f-f1488c9085e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030968 Aug 24 12:42:13.825127 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 502/998] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:14.217084 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-05c497fb-df89-4db0-9cf0-969fe95f8bc5 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:14.217683 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-05c497fb-df89-4db0-9cf0-969fe95f8bc5 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:14.223514 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-05c497fb-df89-4db0-9cf0-969fe95f8bc5 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:14.224024 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-05c497fb-df89-4db0-9cf0-969fe95f8bc5 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:14.224452 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-05c497fb-df89-4db0-9cf0-969fe95f8bc5 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:14.225128 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-05c497fb-df89-4db0-9cf0-969fe95f8bc5 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:14.225575 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-05c497fb-df89-4db0-9cf0-969fe95f8bc5 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:14.225993 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-05c497fb-df89-4db0-9cf0-969fe95f8bc5 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:14.256705 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-05c497fb-df89-4db0-9cf0-969fe95f8bc5 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:14.257339 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-05c497fb-df89-4db0-9cf0-969fe95f8bc5 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:14.257770 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-05c497fb-df89-4db0-9cf0-969fe95f8bc5 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:14.258205 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-05c497fb-df89-4db0-9cf0-969fe95f8bc5 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lazy-loading 'fault' on Instance uuid dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:42:14.298805 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-05c497fb-df89-4db0-9cf0-969fe95f8bc5 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:14.306410 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-05c497fb-df89-4db0-9cf0-969fe95f8bc5 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 200 len: 1231 microversion: 2.1 time: 0.093136 Aug 24 12:42:14.307546 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 497/999] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:14 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:14.789886 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-84c354da-673c-4f1e-bcc7-97dfe1fcb354 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:14.790579 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-84c354da-673c-4f1e-bcc7-97dfe1fcb354 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:14.796739 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-84c354da-673c-4f1e-bcc7-97dfe1fcb354 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:14.797221 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-84c354da-673c-4f1e-bcc7-97dfe1fcb354 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:14.797650 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-84c354da-673c-4f1e-bcc7-97dfe1fcb354 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:14.798327 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-84c354da-673c-4f1e-bcc7-97dfe1fcb354 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:14.798776 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-84c354da-673c-4f1e-bcc7-97dfe1fcb354 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:14.799193 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-84c354da-673c-4f1e-bcc7-97dfe1fcb354 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:14.944929 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-84c354da-673c-4f1e-bcc7-97dfe1fcb354 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:14.954250 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-84c354da-673c-4f1e-bcc7-97dfe1fcb354 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.169007 Aug 24 12:42:14.954807 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 503/1000] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:14 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:15.329145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1af70be2-46bb-4422-97e4-17c3990ed00b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:15.329726 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-1af70be2-46bb-4422-97e4-17c3990ed00b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:15.336047 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1af70be2-46bb-4422-97e4-17c3990ed00b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:15.336521 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1af70be2-46bb-4422-97e4-17c3990ed00b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:15.336947 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1af70be2-46bb-4422-97e4-17c3990ed00b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:15.337618 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1af70be2-46bb-4422-97e4-17c3990ed00b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:15.338150 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1af70be2-46bb-4422-97e4-17c3990ed00b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:15.338629 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-1af70be2-46bb-4422-97e4-17c3990ed00b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:15.351841 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-1af70be2-46bb-4422-97e4-17c3990ed00b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] HTTP exception thrown: Instance dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 could not be found. Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1af70be2-46bb-4422-97e4-17c3990ed00b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Request method failure captured: Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 HTTP/1.1 Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhrMbzVlgAJuK48N__SomnhkvQksnaHN-tfYRcQII9klqdSLnHB1qTWELLHRFtO4kr3rSnmywVeDWo8659gOx13imLD8TdicULFr7i0qkvDR5HUfOq15mMSlr-fgao2fZtfPXW5yGh67ifYvboG875k4AepdjEhWjJFvsz9CNdTB6A0 Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: aee96e55a6a34dbb81847961d87abad0 Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-TestVolumeBootPattern-1229545468 Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:42:15.353437 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:42:15.355875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:42:15.355875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-TestVolumeBootPattern-1229545468 Aug 24 12:42:15.355875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: aee96e55a6a34dbb81847961d87abad0 Aug 24 12:42:15.355875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229545468 Aug 24 12:42:15.355875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-TestVolumeBootPattern-1229545468-project Aug 24 12:42:15.355875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:42:15.355875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:42:15.355875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 18f8f419b523440f8a4ca06dc83bff40 Aug 24 12:42:15.355875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-TestVolumeBootPattern-1229545468-project Aug 24 12:42:15.355875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:42:15.355875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 could not be found. Aug 24 12:42:15.355875 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': 'dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7'} Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 could not be found. Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:42:15.357063 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 could not be found. Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 could not be found. Aug 24 12:42:15.358727 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:42:15.360360 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-1af70be2-46bb-4422-97e4-17c3990ed00b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Returning 404 to user: Instance dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:42:15.360360 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-1af70be2-46bb-4422-97e4-17c3990ed00b tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7" status: 404 len: 111 microversion: 2.1 time: 0.030182 Aug 24 12:42:15.360360 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 498/1001] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:15 2022] GET /compute/v2.1/servers/dd2096b8-0ad6-4b98-a64e-5323e2eaf7f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:42:15.975755 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b63e4370-11ab-463e-b14b-c7303ef5aacb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:15.976437 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-b63e4370-11ab-463e-b14b-c7303ef5aacb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:15.982883 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b63e4370-11ab-463e-b14b-c7303ef5aacb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:15.983361 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b63e4370-11ab-463e-b14b-c7303ef5aacb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:15.983829 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b63e4370-11ab-463e-b14b-c7303ef5aacb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:15.984510 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b63e4370-11ab-463e-b14b-c7303ef5aacb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:15.984954 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b63e4370-11ab-463e-b14b-c7303ef5aacb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:15.985368 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b63e4370-11ab-463e-b14b-c7303ef5aacb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:16.126258 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b63e4370-11ab-463e-b14b-c7303ef5aacb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:16.134366 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b63e4370-11ab-463e-b14b-c7303ef5aacb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.162661 Aug 24 12:42:16.135530 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 504/1002] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:15 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:17.156991 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-7a5ec087-e7f3-48f9-9115-88dacb7b4124 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:17.157530 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-7a5ec087-e7f3-48f9-9115-88dacb7b4124 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:17.163869 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7a5ec087-e7f3-48f9-9115-88dacb7b4124 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:17.164344 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7a5ec087-e7f3-48f9-9115-88dacb7b4124 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:17.164771 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7a5ec087-e7f3-48f9-9115-88dacb7b4124 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:17.165446 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7a5ec087-e7f3-48f9-9115-88dacb7b4124 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:17.165887 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7a5ec087-e7f3-48f9-9115-88dacb7b4124 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:17.166960 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-7a5ec087-e7f3-48f9-9115-88dacb7b4124 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:17.307996 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-7a5ec087-e7f3-48f9-9115-88dacb7b4124 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:17.316193 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-7a5ec087-e7f3-48f9-9115-88dacb7b4124 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.163154 Aug 24 12:42:17.316743 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 499/1003] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:17 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:18.338053 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-148da19a-8fde-41de-b00a-855b31d30fed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:18.338842 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-148da19a-8fde-41de-b00a-855b31d30fed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:18.345376 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-148da19a-8fde-41de-b00a-855b31d30fed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:18.345978 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-148da19a-8fde-41de-b00a-855b31d30fed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:18.346487 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-148da19a-8fde-41de-b00a-855b31d30fed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:18.347262 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-148da19a-8fde-41de-b00a-855b31d30fed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:18.347751 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-148da19a-8fde-41de-b00a-855b31d30fed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:18.348182 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-148da19a-8fde-41de-b00a-855b31d30fed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:18.419710 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e87d2fe4-102f-43a8-8e89-52cf8215412d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:18.421022 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e87d2fe4-102f-43a8-8e89-52cf8215412d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:18.428084 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e87d2fe4-102f-43a8-8e89-52cf8215412d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:18.429101 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e87d2fe4-102f-43a8-8e89-52cf8215412d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:18.429690 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e87d2fe4-102f-43a8-8e89-52cf8215412d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:18.430547 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e87d2fe4-102f-43a8-8e89-52cf8215412d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:18.431003 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e87d2fe4-102f-43a8-8e89-52cf8215412d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:18.431420 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-e87d2fe4-102f-43a8-8e89-52cf8215412d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:18.458387 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-e87d2fe4-102f-43a8-8e89-52cf8215412d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Going to try to terminate instance {{(pid=127308) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:42:18.509030 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-148da19a-8fde-41de-b00a-855b31d30fed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:18.518601 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-148da19a-8fde-41de-b00a-855b31d30fed tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.184464 Aug 24 12:42:18.524176 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 505/1004] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:18 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:18.524176 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-83853d3d-ff69-4242-beef-44f3b0d74ed9 req-30465365-35de-43ed-9479-f0ef368e9b3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee223a9-b84a-4d31-8bd1-a8335fbceff5", "tag": "da346dda-746e-4fae-941a-4376508f9cef"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:42:18.542445 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-83853d3d-ff69-4242-beef-44f3b0d74ed9 req-30465365-35de-43ed-9479-f0ef368e9b3d service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:18.544311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e87d2fe4-102f-43a8-8e89-52cf8215412d tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 204 len: 0 microversion: 2.1 time: 0.129397 Aug 24 12:42:18.545336 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-83853d3d-ff69-4242-beef-44f3b0d74ed9 req-30465365-35de-43ed-9479-f0ef368e9b3d service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:18.545863 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-83853d3d-ff69-4242-beef-44f3b0d74ed9 req-30465365-35de-43ed-9479-f0ef368e9b3d service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:18.546269 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 500/1005] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:42:18 2022] DELETE /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 12:42:18.556157 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-d53e0007-3294-4afc-b68e-382dc57b0148 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:18.557973 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-d53e0007-3294-4afc-b68e-382dc57b0148 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:18.561221 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-83853d3d-ff69-4242-beef-44f3b0d74ed9 req-30465365-35de-43ed-9479-f0ef368e9b3d service nova] Creating event network-changed:da346dda-746e-4fae-941a-4376508f9cef for instance cee223a9-b84a-4d31-8bd1-a8335fbceff5 on hv-cinder-84890 Aug 24 12:42:18.564716 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d53e0007-3294-4afc-b68e-382dc57b0148 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:18.565259 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d53e0007-3294-4afc-b68e-382dc57b0148 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:18.565835 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d53e0007-3294-4afc-b68e-382dc57b0148 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:18.566550 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-83853d3d-ff69-4242-beef-44f3b0d74ed9 req-30465365-35de-43ed-9479-f0ef368e9b3d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046118 Aug 24 12:42:18.566680 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d53e0007-3294-4afc-b68e-382dc57b0148 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:18.567009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d53e0007-3294-4afc-b68e-382dc57b0148 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:18.567487 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-d53e0007-3294-4afc-b68e-382dc57b0148 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:18.567633 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 506/1006] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:18.701863 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-d53e0007-3294-4afc-b68e-382dc57b0148 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:18.709587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-d53e0007-3294-4afc-b68e-382dc57b0148 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1578 microversion: 2.1 time: 0.158878 Aug 24 12:42:18.710143 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 501/1007] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:18 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:19.544432 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f6a6c7af-3b74-4fef-a304-956863739772 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:19.545126 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f6a6c7af-3b74-4fef-a304-956863739772 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:19.551358 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f6a6c7af-3b74-4fef-a304-956863739772 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:19.551877 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f6a6c7af-3b74-4fef-a304-956863739772 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:19.552312 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f6a6c7af-3b74-4fef-a304-956863739772 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:19.553005 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f6a6c7af-3b74-4fef-a304-956863739772 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:19.553454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f6a6c7af-3b74-4fef-a304-956863739772 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:19.553872 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f6a6c7af-3b74-4fef-a304-956863739772 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:19.702326 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f6a6c7af-3b74-4fef-a304-956863739772 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:19.710661 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f6a6c7af-3b74-4fef-a304-956863739772 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.171686 Aug 24 12:42:19.711259 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 507/1008] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:19 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:19.731352 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-db8c06b0-792e-4e5b-a074-348aa21f95e9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:19.732041 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-db8c06b0-792e-4e5b-a074-348aa21f95e9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:19.738374 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db8c06b0-792e-4e5b-a074-348aa21f95e9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:19.738851 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db8c06b0-792e-4e5b-a074-348aa21f95e9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:19.739282 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db8c06b0-792e-4e5b-a074-348aa21f95e9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:19.739999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db8c06b0-792e-4e5b-a074-348aa21f95e9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:19.740450 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db8c06b0-792e-4e5b-a074-348aa21f95e9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:19.740869 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db8c06b0-792e-4e5b-a074-348aa21f95e9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:19.877145 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-db8c06b0-792e-4e5b-a074-348aa21f95e9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:19.885023 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-db8c06b0-792e-4e5b-a074-348aa21f95e9 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1578 microversion: 2.1 time: 0.158721 Aug 24 12:42:19.885596 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 502/1009] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:19 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:20.731640 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-58e70609-3aac-408e-a105-1882805a4106 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:20.732301 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-58e70609-3aac-408e-a105-1882805a4106 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:20.738685 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58e70609-3aac-408e-a105-1882805a4106 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:20.739166 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58e70609-3aac-408e-a105-1882805a4106 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:20.739592 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58e70609-3aac-408e-a105-1882805a4106 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:20.740306 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58e70609-3aac-408e-a105-1882805a4106 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:20.740771 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58e70609-3aac-408e-a105-1882805a4106 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:20.741204 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-58e70609-3aac-408e-a105-1882805a4106 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:20.907213 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-db62ce13-97b0-496f-8043-f1ead407c6ed tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:20.909617 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-db62ce13-97b0-496f-8043-f1ead407c6ed tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:20.917371 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db62ce13-97b0-496f-8043-f1ead407c6ed tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:20.917530 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db62ce13-97b0-496f-8043-f1ead407c6ed tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:20.918041 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db62ce13-97b0-496f-8043-f1ead407c6ed tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:20.919041 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db62ce13-97b0-496f-8043-f1ead407c6ed tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:20.919742 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db62ce13-97b0-496f-8043-f1ead407c6ed tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:20.920291 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-db62ce13-97b0-496f-8043-f1ead407c6ed tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:20.991037 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-58e70609-3aac-408e-a105-1882805a4106 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:21.001814 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-58e70609-3aac-408e-a105-1882805a4106 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.273833 Aug 24 12:42:21.002417 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 508/1010] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:20 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:21.007919 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-a72a6dbd-ae54-4396-abfb-33c23c290540 req-f4f94f04-e6ec-42c2-8e94-780f1e81e2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee223a9-b84a-4d31-8bd1-a8335fbceff5", "name": "network-vif-deleted", "tag": "da346dda-746e-4fae-941a-4376508f9cef"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:42:21.011948 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-db62ce13-97b0-496f-8043-f1ead407c6ed tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f8f419b523440f8a4ca06dc83bff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee96e55a6a34dbb81847961d87abad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:21.018549 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-a72a6dbd-ae54-4396-abfb-33c23c290540 req-f4f94f04-e6ec-42c2-8e94-780f1e81e2a5 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:21.019268 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-a72a6dbd-ae54-4396-abfb-33c23c290540 req-f4f94f04-e6ec-42c2-8e94-780f1e81e2a5 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:21.019773 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-a72a6dbd-ae54-4396-abfb-33c23c290540 req-f4f94f04-e6ec-42c2-8e94-780f1e81e2a5 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:21.020035 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-db62ce13-97b0-496f-8043-f1ead407c6ed tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 200 len: 1392 microversion: 2.1 time: 0.116628 Aug 24 12:42:21.020905 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 503/1011] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:20 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 1392 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:21.038447 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-a72a6dbd-ae54-4396-abfb-33c23c290540 req-f4f94f04-e6ec-42c2-8e94-780f1e81e2a5 service nova] Creating event network-vif-deleted:da346dda-746e-4fae-941a-4376508f9cef for instance cee223a9-b84a-4d31-8bd1-a8335fbceff5 on hv-cinder-84890 Aug 24 12:42:21.043667 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-a72a6dbd-ae54-4396-abfb-33c23c290540 req-f4f94f04-e6ec-42c2-8e94-780f1e81e2a5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039980 Aug 24 12:42:21.044429 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 509/1012] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:22.023112 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-f58a14e3-b013-4bfc-877f-28ce09979861 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:22.023704 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-f58a14e3-b013-4bfc-877f-28ce09979861 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:22.030811 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f58a14e3-b013-4bfc-877f-28ce09979861 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.031290 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f58a14e3-b013-4bfc-877f-28ce09979861 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.031758 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f58a14e3-b013-4bfc-877f-28ce09979861 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.032447 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f58a14e3-b013-4bfc-877f-28ce09979861 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.032896 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f58a14e3-b013-4bfc-877f-28ce09979861 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.033317 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-f58a14e3-b013-4bfc-877f-28ce09979861 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.042699 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-74a84c45-8330-4dd4-b814-f0e46d7f6718 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:22.043395 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-74a84c45-8330-4dd4-b814-f0e46d7f6718 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: cee223a9-b84a-4d31-8bd1-a8335fbceff5] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:22.050247 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74a84c45-8330-4dd4-b814-f0e46d7f6718 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.050731 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74a84c45-8330-4dd4-b814-f0e46d7f6718 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.051197 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74a84c45-8330-4dd4-b814-f0e46d7f6718 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.051912 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74a84c45-8330-4dd4-b814-f0e46d7f6718 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.052389 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74a84c45-8330-4dd4-b814-f0e46d7f6718 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.052805 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74a84c45-8330-4dd4-b814-f0e46d7f6718 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.065953 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-74a84c45-8330-4dd4-b814-f0e46d7f6718 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] HTTP exception thrown: Instance cee223a9-b84a-4d31-8bd1-a8335fbceff5 could not be found. Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-74a84c45-8330-4dd4-b814-f0e46d7f6718 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Request method failure captured: Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 HTTP/1.1 Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhrMbzVlgAJuK48N__SomnhkvQksnaHN-tfYRcQII9klqdSLnHB1qTWELLHRFtO4kr3rSnmywVeDWo8659gOx13imLD8TdicULFr7i0qkvDR5HUfOq15mMSlr-fgao2fZtfPXW5yGh67ifYvboG875k4AepdjEhWjJFvsz9CNdTB6A0 Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: aee96e55a6a34dbb81847961d87abad0 Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-TestVolumeBootPattern-1229545468 Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:42:22.067596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:42:22.069456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:42:22.069456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-TestVolumeBootPattern-1229545468 Aug 24 12:42:22.069456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: aee96e55a6a34dbb81847961d87abad0 Aug 24 12:42:22.069456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229545468 Aug 24 12:42:22.069456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-TestVolumeBootPattern-1229545468-project Aug 24 12:42:22.069456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:42:22.069456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:42:22.069456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 18f8f419b523440f8a4ca06dc83bff40 Aug 24 12:42:22.069456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-TestVolumeBootPattern-1229545468-project Aug 24 12:42:22.069456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:42:22.069456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance cee223a9-b84a-4d31-8bd1-a8335fbceff5 could not be found. Aug 24 12:42:22.069456 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': 'cee223a9-b84a-4d31-8bd1-a8335fbceff5'} Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee223a9-b84a-4d31-8bd1-a8335fbceff5 could not be found. Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:42:22.070454 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee223a9-b84a-4d31-8bd1-a8335fbceff5 could not be found. Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee223a9-b84a-4d31-8bd1-a8335fbceff5 could not be found. Aug 24 12:42:22.072653 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:42:22.074534 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-74a84c45-8330-4dd4-b814-f0e46d7f6718 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Returning 404 to user: Instance cee223a9-b84a-4d31-8bd1-a8335fbceff5 could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:42:22.074534 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-74a84c45-8330-4dd4-b814-f0e46d7f6718 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5" status: 404 len: 111 microversion: 2.1 time: 0.030488 Aug 24 12:42:22.074534 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 510/1013] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:22 2022] GET /compute/v2.1/servers/cee223a9-b84a-4d31-8bd1-a8335fbceff5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 12:42:22.186591 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-f58a14e3-b013-4bfc-877f-28ce09979861 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:22.194670 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-f58a14e3-b013-4bfc-877f-28ce09979861 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.175495 Aug 24 12:42:22.195233 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 504/1014] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:22 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:22.777543 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-bcefb280-92fc-48c2-a7d3-b6bb12a39f74 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:22.778045 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-bcefb280-92fc-48c2-a7d3-b6bb12a39f74 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:22.784129 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcefb280-92fc-48c2-a7d3-b6bb12a39f74 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.784616 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcefb280-92fc-48c2-a7d3-b6bb12a39f74 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.785073 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcefb280-92fc-48c2-a7d3-b6bb12a39f74 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.785793 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcefb280-92fc-48c2-a7d3-b6bb12a39f74 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.786199 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcefb280-92fc-48c2-a7d3-b6bb12a39f74 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.786623 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bcefb280-92fc-48c2-a7d3-b6bb12a39f74 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.800593 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-bcefb280-92fc-48c2-a7d3-b6bb12a39f74 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] HTTP exception thrown: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-bcefb280-92fc-48c2-a7d3-b6bb12a39f74 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Request method failure captured: Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: DELETE /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca HTTP/1.1 Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhrMbzVlgAJuK48N__SomnhkvQksnaHN-tfYRcQII9klqdSLnHB1qTWELLHRFtO4kr3rSnmywVeDWo8659gOx13imLD8TdicULFr7i0qkvDR5HUfOq15mMSlr-fgao2fZtfPXW5yGh67ifYvboG875k4AepdjEhWjJFvsz9CNdTB6A0 Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: aee96e55a6a34dbb81847961d87abad0 Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-TestVolumeBootPattern-1229545468 Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:42:22.802155 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:42:22.803823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:42:22.803823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-TestVolumeBootPattern-1229545468 Aug 24 12:42:22.803823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: aee96e55a6a34dbb81847961d87abad0 Aug 24 12:42:22.803823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229545468 Aug 24 12:42:22.803823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-TestVolumeBootPattern-1229545468-project Aug 24 12:42:22.803823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:42:22.803823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:42:22.803823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: 18f8f419b523440f8a4ca06dc83bff40 Aug 24 12:42:22.803823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-TestVolumeBootPattern-1229545468-project Aug 24 12:42:22.803823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:42:22.803823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. Aug 24 12:42:22.803823 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': '0ab4d787-eab3-4654-8d9c-b7a7f10972ca'} Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:42:22.804756 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. Aug 24 12:42:22.806282 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:42:22.809042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-bcefb280-92fc-48c2-a7d3-b6bb12a39f74 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Returning 404 to user: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:42:22.809042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-bcefb280-92fc-48c2-a7d3-b6bb12a39f74 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 404 len: 111 microversion: 2.1 time: 0.030330 Aug 24 12:42:22.809042 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 511/1015] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:42:22 2022] DELETE /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:42:22.812916 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ff67a468-d88c-4ae2-a02e-c3bcfc7ad80c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:22.813520 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-ff67a468-d88c-4ae2-a02e-c3bcfc7ad80c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] [instance: 0ab4d787-eab3-4654-8d9c-b7a7f10972ca] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:22.819424 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ff67a468-d88c-4ae2-a02e-c3bcfc7ad80c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.819934 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ff67a468-d88c-4ae2-a02e-c3bcfc7ad80c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.820362 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ff67a468-d88c-4ae2-a02e-c3bcfc7ad80c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.821036 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ff67a468-d88c-4ae2-a02e-c3bcfc7ad80c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.821480 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ff67a468-d88c-4ae2-a02e-c3bcfc7ad80c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.821896 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-ff67a468-d88c-4ae2-a02e-c3bcfc7ad80c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.835209 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-ff67a468-d88c-4ae2-a02e-c3bcfc7ad80c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] HTTP exception thrown: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ff67a468-d88c-4ae2-a02e-c3bcfc7ad80c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Request method failure captured: Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca HTTP/1.1 Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhrMbzVlgAJuK48N__SomnhkvQksnaHN-tfYRcQII9klqdSLnHB1qTWELLHRFtO4kr3rSnmywVeDWo8659gOx13imLD8TdicULFr7i0qkvDR5HUfOq15mMSlr-fgao2fZtfPXW5yGh67ifYvboG875k4AepdjEhWjJFvsz9CNdTB6A0 Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: aee96e55a6a34dbb81847961d87abad0 Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-TestVolumeBootPattern-1229545468 Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:42:22.836864 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:42:22.838559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aee96e55a6a34dbb81847961d87abad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:42:22.838559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-TestVolumeBootPattern-1229545468 Aug 24 12:42:22.838559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: aee96e55a6a34dbb81847961d87abad0 Aug 24 12:42:22.838559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229545468 Aug 24 12:42:22.838559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-TestVolumeBootPattern-1229545468-project Aug 24 12:42:22.838559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:42:22.838559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:42:22.838559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 18f8f419b523440f8a4ca06dc83bff40 Aug 24 12:42:22.838559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-TestVolumeBootPattern-1229545468-project Aug 24 12:42:22.838559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:42:22.838559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. Aug 24 12:42:22.838559 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '0ab4d787-eab3-4654-8d9c-b7a7f10972ca'} Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:42:22.839406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. Aug 24 12:42:22.840730 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:42:22.841887 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-ff67a468-d88c-4ae2-a02e-c3bcfc7ad80c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Returning 404 to user: Instance 0ab4d787-eab3-4654-8d9c-b7a7f10972ca could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:42:22.841887 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-ff67a468-d88c-4ae2-a02e-c3bcfc7ad80c tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca" status: 404 len: 111 microversion: 2.1 time: 0.029189 Aug 24 12:42:22.841887 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 505/1016] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:22 2022] GET /compute/v2.1/servers/0ab4d787-eab3-4654-8d9c-b7a7f10972ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:42:23.221401 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-3db53f3f-f88e-472b-b58b-305ed79275eb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:23.222045 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-3db53f3f-f88e-472b-b58b-305ed79275eb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:23.228704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3db53f3f-f88e-472b-b58b-305ed79275eb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:23.229194 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3db53f3f-f88e-472b-b58b-305ed79275eb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:23.229643 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3db53f3f-f88e-472b-b58b-305ed79275eb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:23.230968 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3db53f3f-f88e-472b-b58b-305ed79275eb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:23.231443 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3db53f3f-f88e-472b-b58b-305ed79275eb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:23.231945 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-3db53f3f-f88e-472b-b58b-305ed79275eb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:23.427718 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-3db53f3f-f88e-472b-b58b-305ed79275eb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:23.436047 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-3db53f3f-f88e-472b-b58b-305ed79275eb tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.218679 Aug 24 12:42:23.436605 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 512/1017] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:23 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:24.133821 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-e8062bd8-0df4-4f8e-9f84-d0c1eda0c8b8 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] Calling method '.version_select at 0x7f4696c68d30>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:24.157342 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-e8062bd8-0df4-4f8e-9f84-d0c1eda0c8b8 tempest-TestVolumeBootPattern-1229545468 tempest-TestVolumeBootPattern-1229545468-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1946886811" status: 202 len: 0 microversion: 2.1 time: 0.027263 Aug 24 12:42:24.158177 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 506/1018] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 12:42:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1946886811 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:42:24.458201 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-6048c459-b900-4027-837b-bda3f81d8899 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:24.458813 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-6048c459-b900-4027-837b-bda3f81d8899 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:24.465378 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6048c459-b900-4027-837b-bda3f81d8899 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:24.465867 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6048c459-b900-4027-837b-bda3f81d8899 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:24.466303 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6048c459-b900-4027-837b-bda3f81d8899 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:24.466998 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6048c459-b900-4027-837b-bda3f81d8899 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:24.467450 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6048c459-b900-4027-837b-bda3f81d8899 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:24.467895 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-6048c459-b900-4027-837b-bda3f81d8899 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:24.685355 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-6048c459-b900-4027-837b-bda3f81d8899 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:24.693587 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-6048c459-b900-4027-837b-bda3f81d8899 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.239207 Aug 24 12:42:24.694157 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 513/1019] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:24 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:25.717495 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b08d67fc-b497-4554-b3cb-b7890b7b1838 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:25.718071 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b08d67fc-b497-4554-b3cb-b7890b7b1838 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:25.725360 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b08d67fc-b497-4554-b3cb-b7890b7b1838 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:25.725844 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b08d67fc-b497-4554-b3cb-b7890b7b1838 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:25.726276 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b08d67fc-b497-4554-b3cb-b7890b7b1838 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:25.726960 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b08d67fc-b497-4554-b3cb-b7890b7b1838 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:25.727413 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b08d67fc-b497-4554-b3cb-b7890b7b1838 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:25.727882 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b08d67fc-b497-4554-b3cb-b7890b7b1838 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:26.026209 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-b08d67fc-b497-4554-b3cb-b7890b7b1838 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:26.036565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b08d67fc-b497-4554-b3cb-b7890b7b1838 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.323042 Aug 24 12:42:26.039674 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 507/1020] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:25 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:27.059348 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-85aee109-a64d-4e87-8612-14ee79c5890d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:27.060480 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-85aee109-a64d-4e87-8612-14ee79c5890d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:27.067879 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85aee109-a64d-4e87-8612-14ee79c5890d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:27.068478 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85aee109-a64d-4e87-8612-14ee79c5890d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:27.068993 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85aee109-a64d-4e87-8612-14ee79c5890d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:27.069781 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85aee109-a64d-4e87-8612-14ee79c5890d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:27.070484 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85aee109-a64d-4e87-8612-14ee79c5890d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:27.071003 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-85aee109-a64d-4e87-8612-14ee79c5890d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:27.234055 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-85aee109-a64d-4e87-8612-14ee79c5890d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:27.254312 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-85aee109-a64d-4e87-8612-14ee79c5890d tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.199550 Aug 24 12:42:27.255138 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 514/1021] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:27 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:28.276341 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-0f83b00a-6b2b-4236-bdf6-e2969917a76e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:28.276940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-0f83b00a-6b2b-4236-bdf6-e2969917a76e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:28.283538 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0f83b00a-6b2b-4236-bdf6-e2969917a76e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:28.284068 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0f83b00a-6b2b-4236-bdf6-e2969917a76e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:28.284505 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0f83b00a-6b2b-4236-bdf6-e2969917a76e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:28.285199 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0f83b00a-6b2b-4236-bdf6-e2969917a76e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:28.285648 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0f83b00a-6b2b-4236-bdf6-e2969917a76e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:28.286069 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0f83b00a-6b2b-4236-bdf6-e2969917a76e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:28.504398 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-0f83b00a-6b2b-4236-bdf6-e2969917a76e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:28.513776 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-0f83b00a-6b2b-4236-bdf6-e2969917a76e tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1757 microversion: 2.1 time: 0.241664 Aug 24 12:42:28.514349 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 508/1022] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:28 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1757 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:29.534318 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-83f026df-2e2a-46c6-9b91-900e67b8ecdc tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:29.534928 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-83f026df-2e2a-46c6-9b91-900e67b8ecdc tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:29.541860 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-83f026df-2e2a-46c6-9b91-900e67b8ecdc tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:29.542344 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-83f026df-2e2a-46c6-9b91-900e67b8ecdc tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:29.543233 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-83f026df-2e2a-46c6-9b91-900e67b8ecdc tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:29.543965 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-83f026df-2e2a-46c6-9b91-900e67b8ecdc tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:29.544425 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-83f026df-2e2a-46c6-9b91-900e67b8ecdc tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:29.544842 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-83f026df-2e2a-46c6-9b91-900e67b8ecdc tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:29.802622 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-83f026df-2e2a-46c6-9b91-900e67b8ecdc tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:29.811944 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-83f026df-2e2a-46c6-9b91-900e67b8ecdc tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1760 microversion: 2.1 time: 0.281336 Aug 24 12:42:29.812529 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 515/1023] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:29 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1760 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:02.595457 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b9ba0686-04d9-4ad1-88a3-623182b3a719 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1324348453"}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:43:02.596061 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b9ba0686-04d9-4ad1-88a3-623182b3a719 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:02.598258 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:02.599081 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:02.606565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b9ba0686-04d9-4ad1-88a3-623182b3a719 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:02.607048 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b9ba0686-04d9-4ad1-88a3-623182b3a719 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:02.607476 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b9ba0686-04d9-4ad1-88a3-623182b3a719 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:02.608204 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b9ba0686-04d9-4ad1-88a3-623182b3a719 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:02.608669 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b9ba0686-04d9-4ad1-88a3-623182b3a719 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:02.609082 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b9ba0686-04d9-4ad1-88a3-623182b3a719 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:02.737288 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.network.security_group_api [None req-b9ba0686-04d9-4ad1-88a3-623182b3a719 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Removing security group b0f13c08-1252-497d-9be6-3e20386dae88 from port 7f1e74a4-26c6-4ea0-b25c-b771e422659e Aug 24 12:43:03.039806 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b9ba0686-04d9-4ad1-88a3-623182b3a719 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "POST /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/action" status: 202 len: 0 microversion: 2.1 time: 0.448184 Aug 24 12:43:03.044492 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 509/1024] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 12:43:02 2022] POST /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:43:03.051451 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-87f30ad9-7f43-4a0a-955e-90ec7d88a2cb req-d19e2d0d-5284-4266-9014-edb9cb463cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e9f003-88e1-43bb-8b20-9bb3c12bdb62", "tag": "7f1e74a4-26c6-4ea0-b25c-b771e422659e"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:43:03.063830 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=37 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:03.065417 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=69 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:03.067898 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-87f30ad9-7f43-4a0a-955e-90ec7d88a2cb req-d19e2d0d-5284-4266-9014-edb9cb463cfa service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:03.068628 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-87f30ad9-7f43-4a0a-955e-90ec7d88a2cb req-d19e2d0d-5284-4266-9014-edb9cb463cfa service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:03.069405 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-87f30ad9-7f43-4a0a-955e-90ec7d88a2cb req-d19e2d0d-5284-4266-9014-edb9cb463cfa service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:03.089769 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-87f30ad9-7f43-4a0a-955e-90ec7d88a2cb req-d19e2d0d-5284-4266-9014-edb9cb463cfa service nova] Creating event network-changed:7f1e74a4-26c6-4ea0-b25c-b771e422659e for instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 on hv-cinder-84890 Aug 24 12:43:03.097081 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-87f30ad9-7f43-4a0a-955e-90ec7d88a2cb req-d19e2d0d-5284-4266-9014-edb9cb463cfa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049188 Aug 24 12:43:03.098377 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 516/1025] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:04.687949 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4dbcea65-c522-48c8-b0cb-ebc73a0cd42c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:04.688478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4dbcea65-c522-48c8-b0cb-ebc73a0cd42c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:04.694417 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4dbcea65-c522-48c8-b0cb-ebc73a0cd42c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:04.694928 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4dbcea65-c522-48c8-b0cb-ebc73a0cd42c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:04.695367 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4dbcea65-c522-48c8-b0cb-ebc73a0cd42c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:04.696101 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4dbcea65-c522-48c8-b0cb-ebc73a0cd42c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:04.696555 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4dbcea65-c522-48c8-b0cb-ebc73a0cd42c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:04.697744 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4dbcea65-c522-48c8-b0cb-ebc73a0cd42c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:04.778103 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-4dbcea65-c522-48c8-b0cb-ebc73a0cd42c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lazy-loading 'services' on Instance uuid 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:43:04.852052 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4dbcea65-c522-48c8-b0cb-ebc73a0cd42c tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "DELETE /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/os-volume_attachments/0255f4a6-f49c-4965-9972-13546cd0e51a" status: 202 len: 0 microversion: 2.1 time: 0.168531 Aug 24 12:43:04.853064 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 510/1026] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 12:43:04 2022] DELETE /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/os-volume_attachments/0255f4a6-f49c-4965-9972-13546cd0e51a => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:43:04.861988 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b6494169-ccf2-45b2-be0d-a3c49e6db018 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:04.864226 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-b6494169-ccf2-45b2-be0d-a3c49e6db018 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:04.871111 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b6494169-ccf2-45b2-be0d-a3c49e6db018 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:04.871594 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b6494169-ccf2-45b2-be0d-a3c49e6db018 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:04.872959 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b6494169-ccf2-45b2-be0d-a3c49e6db018 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:04.872959 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b6494169-ccf2-45b2-be0d-a3c49e6db018 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:04.873195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b6494169-ccf2-45b2-be0d-a3c49e6db018 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:04.873601 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b6494169-ccf2-45b2-be0d-a3c49e6db018 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:04.904202 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b6494169-ccf2-45b2-be0d-a3c49e6db018 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046951 Aug 24 12:43:04.905166 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 517/1027] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:04 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:05.114803 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-aa586182-23b4-4d6e-9ee0-f1ad9b919455 req-23e588ef-6e38-4da1-a2de-9618264ed46b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e9f003-88e1-43bb-8b20-9bb3c12bdb62", "tag": "7f1e74a4-26c6-4ea0-b25c-b771e422659e"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:43:05.125327 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-aa586182-23b4-4d6e-9ee0-f1ad9b919455 req-23e588ef-6e38-4da1-a2de-9618264ed46b service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:05.126024 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-aa586182-23b4-4d6e-9ee0-f1ad9b919455 req-23e588ef-6e38-4da1-a2de-9618264ed46b service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:05.126638 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-aa586182-23b4-4d6e-9ee0-f1ad9b919455 req-23e588ef-6e38-4da1-a2de-9618264ed46b service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:05.138006 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-aa586182-23b4-4d6e-9ee0-f1ad9b919455 req-23e588ef-6e38-4da1-a2de-9618264ed46b service nova] Creating event network-changed:7f1e74a4-26c6-4ea0-b25c-b771e422659e for instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 on hv-cinder-84890 Aug 24 12:43:05.142861 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-aa586182-23b4-4d6e-9ee0-f1ad9b919455 req-23e588ef-6e38-4da1-a2de-9618264ed46b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032037 Aug 24 12:43:05.143439 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 511/1028] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:05.918589 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-66a50ba9-6d56-4b6a-8cf4-79f847a66a96 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:05.920701 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-66a50ba9-6d56-4b6a-8cf4-79f847a66a96 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:05.926999 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66a50ba9-6d56-4b6a-8cf4-79f847a66a96 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:05.927485 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66a50ba9-6d56-4b6a-8cf4-79f847a66a96 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:05.927959 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66a50ba9-6d56-4b6a-8cf4-79f847a66a96 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:05.928656 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66a50ba9-6d56-4b6a-8cf4-79f847a66a96 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:05.929113 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66a50ba9-6d56-4b6a-8cf4-79f847a66a96 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:05.929541 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-66a50ba9-6d56-4b6a-8cf4-79f847a66a96 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:05.960126 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-66a50ba9-6d56-4b6a-8cf4-79f847a66a96 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046093 Aug 24 12:43:05.960658 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 518/1029] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:05 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:43:05.972888 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-bfae34f2-dbae-4fa7-8d50-26cb339b1611 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:05.973507 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-bfae34f2-dbae-4fa7-8d50-26cb339b1611 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:05.980725 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bfae34f2-dbae-4fa7-8d50-26cb339b1611 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:05.981208 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bfae34f2-dbae-4fa7-8d50-26cb339b1611 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:05.981645 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bfae34f2-dbae-4fa7-8d50-26cb339b1611 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:05.982383 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bfae34f2-dbae-4fa7-8d50-26cb339b1611 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:05.982827 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bfae34f2-dbae-4fa7-8d50-26cb339b1611 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:05.983268 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bfae34f2-dbae-4fa7-8d50-26cb339b1611 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:06.056070 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-bfae34f2-dbae-4fa7-8d50-26cb339b1611 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] HTTP exception thrown: Instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 is not attached to volume 0255f4a6-f49c-4965-9972-13546cd0e51a Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-bfae34f2-dbae-4fa7-8d50-26cb339b1611 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Request method failure captured: Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: DELETE /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/os-volume_attachments/0255f4a6-f49c-4965-9972-13546cd0e51a HTTP/1.1 Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhxRw_w7BM4KvRut4vp01KYx6Vj8RRQ8vlSvnoGuuaPwa9qotoO3KVlwRM_eqDH9G_53XkFVpJqTDoOmCWChDDavyoX2-NZAC6T3eyxgUDlY_eDy2pC138jcyWULdoZGs8VhkPKLEXKDsYQ3ugc2GyIpaqIXyvC5JNdcjo-FXiqAQJk Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 399ad86f3c61455bba626fd9e556e6e0 Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-TestMinimumBasicScenario-135685366 Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:43:06.067522 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:43:06.069357 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/399ad86f3c61455bba626fd9e556e6e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/399ad86f3c61455bba626fd9e556e6e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/399ad86f3c61455bba626fd9e556e6e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_399ad86f3c61455bba626fd9e556e6e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:43:06.069357 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-TestMinimumBasicScenario-135685366 Aug 24 12:43:06.069357 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 399ad86f3c61455bba626fd9e556e6e0 Aug 24 12:43:06.069357 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-TestMinimumBasicScenario-135685366 Aug 24 12:43:06.069357 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-TestMinimumBasicScenario-135685366-project Aug 24 12:43:06.069357 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:43:06.069357 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:43:06.069357 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 8aedc727a81a40c2993097e35485233c Aug 24 12:43:06.069357 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-TestMinimumBasicScenario-135685366-project Aug 24 12:43:06.069357 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:43:06.069357 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 is not attached to volume 0255f4a6-f49c-4965-9972-13546cd0e51a Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'server_id': '88e9f003-88e1-43bb-8b20-9bb3c12bdb62', 'id': '0255f4a6-f49c-4965-9972-13546cd0e51a'} Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0255f4a6-f49c-4965-9972-13546cd0e51a. Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:43:06.070462 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:43:06.073009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:43:06.073009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 12:43:06.073009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 12:43:06.073009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 is not attached to volume 0255f4a6-f49c-4965-9972-13546cd0e51a Aug 24 12:43:06.073009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:43:06.073009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:43:06.073009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:43:06.073009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:43:06.073009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:43:06.073009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:43:06.073009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:43:06.073009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:43:06.073009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 is not attached to volume 0255f4a6-f49c-4965-9972-13546cd0e51a Aug 24 12:43:06.073009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:43:06.073009 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-bfae34f2-dbae-4fa7-8d50-26cb339b1611 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Returning 404 to user: Instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 is not attached to volume 0255f4a6-f49c-4965-9972-13546cd0e51a {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:43:06.074315 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-bfae34f2-dbae-4fa7-8d50-26cb339b1611 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "DELETE /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/os-volume_attachments/0255f4a6-f49c-4965-9972-13546cd0e51a" status: 404 len: 154 microversion: 2.1 time: 0.100860 Aug 24 12:43:06.074315 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 512/1030] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 12:43:05 2022] DELETE /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62/os-volume_attachments/0255f4a6-f49c-4965-9972-13546cd0e51a => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:43:07.210605 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e87b8667-afb0-4ce0-857d-15ae0ea53a94 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:07.211108 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e87b8667-afb0-4ce0-857d-15ae0ea53a94 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:07.217931 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e87b8667-afb0-4ce0-857d-15ae0ea53a94 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:07.218414 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e87b8667-afb0-4ce0-857d-15ae0ea53a94 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:07.218851 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e87b8667-afb0-4ce0-857d-15ae0ea53a94 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:07.219539 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e87b8667-afb0-4ce0-857d-15ae0ea53a94 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:07.220021 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e87b8667-afb0-4ce0-857d-15ae0ea53a94 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:07.220443 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e87b8667-afb0-4ce0-857d-15ae0ea53a94 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:07.244478 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e87b8667-afb0-4ce0-857d-15ae0ea53a94 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Going to try to terminate instance {{(pid=127307) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:43:07.317762 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e87b8667-afb0-4ce0-857d-15ae0ea53a94 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "DELETE /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 204 len: 0 microversion: 2.1 time: 0.110478 Aug 24 12:43:07.318728 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 519/1031] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:43:07 2022] DELETE /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:43:07.328514 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9ffa79b4-343d-4124-bb75-b7775fd947c4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:07.329166 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9ffa79b4-343d-4124-bb75-b7775fd947c4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:07.338110 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ffa79b4-343d-4124-bb75-b7775fd947c4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:07.338619 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ffa79b4-343d-4124-bb75-b7775fd947c4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:07.339113 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ffa79b4-343d-4124-bb75-b7775fd947c4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:07.339848 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ffa79b4-343d-4124-bb75-b7775fd947c4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:07.340300 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ffa79b4-343d-4124-bb75-b7775fd947c4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:07.340744 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9ffa79b4-343d-4124-bb75-b7775fd947c4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:07.472945 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9ffa79b4-343d-4124-bb75-b7775fd947c4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:07.480565 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9ffa79b4-343d-4124-bb75-b7775fd947c4 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1554 microversion: 2.1 time: 0.156076 Aug 24 12:43:07.481147 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 513/1032] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:07 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:08.502766 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-1b425440-efa8-42d6-be0d-7069e6b533b8 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:08.503452 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-1b425440-efa8-42d6-be0d-7069e6b533b8 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:08.510318 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1b425440-efa8-42d6-be0d-7069e6b533b8 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:08.510775 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1b425440-efa8-42d6-be0d-7069e6b533b8 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:08.511212 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1b425440-efa8-42d6-be0d-7069e6b533b8 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:08.511937 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1b425440-efa8-42d6-be0d-7069e6b533b8 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:08.512385 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1b425440-efa8-42d6-be0d-7069e6b533b8 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:08.512802 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1b425440-efa8-42d6-be0d-7069e6b533b8 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:08.639785 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-1b425440-efa8-42d6-be0d-7069e6b533b8 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:08.647768 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-1b425440-efa8-42d6-be0d-7069e6b533b8 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1554 microversion: 2.1 time: 0.149137 Aug 24 12:43:08.648337 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 520/1033] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:08 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:09.554788 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-86b0befe-759b-481a-9ce1-4d1431201566 req-a653dc19-608c-452e-9e51-450c7f4052ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e9f003-88e1-43bb-8b20-9bb3c12bdb62", "name": "network-vif-deleted", "tag": "7f1e74a4-26c6-4ea0-b25c-b771e422659e"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:43:09.564720 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-86b0befe-759b-481a-9ce1-4d1431201566 req-a653dc19-608c-452e-9e51-450c7f4052ba service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:09.565201 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-86b0befe-759b-481a-9ce1-4d1431201566 req-a653dc19-608c-452e-9e51-450c7f4052ba service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:09.565646 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-86b0befe-759b-481a-9ce1-4d1431201566 req-a653dc19-608c-452e-9e51-450c7f4052ba service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:09.577156 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.compute.server_external_events [req-86b0befe-759b-481a-9ce1-4d1431201566 req-a653dc19-608c-452e-9e51-450c7f4052ba service nova] Creating event network-vif-deleted:7f1e74a4-26c6-4ea0-b25c-b771e422659e for instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 on hv-cinder-84890 Aug 24 12:43:09.581880 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-86b0befe-759b-481a-9ce1-4d1431201566 req-a653dc19-608c-452e-9e51-450c7f4052ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159121 Aug 24 12:43:09.582445 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 514/1034] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:09.668896 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-1f619196-3321-4302-b98f-5116b99d2efd tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:09.669475 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-1f619196-3321-4302-b98f-5116b99d2efd tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:09.676034 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1f619196-3321-4302-b98f-5116b99d2efd tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:09.676530 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1f619196-3321-4302-b98f-5116b99d2efd tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:09.676978 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1f619196-3321-4302-b98f-5116b99d2efd tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:09.677673 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1f619196-3321-4302-b98f-5116b99d2efd tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:09.678125 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1f619196-3321-4302-b98f-5116b99d2efd tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:09.678599 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1f619196-3321-4302-b98f-5116b99d2efd tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:09.712531 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1f619196-3321-4302-b98f-5116b99d2efd tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:09.713099 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1f619196-3321-4302-b98f-5116b99d2efd tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:09.713643 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1f619196-3321-4302-b98f-5116b99d2efd tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:09.714099 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.objects.instance [None req-1f619196-3321-4302-b98f-5116b99d2efd tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lazy-loading 'fault' on Instance uuid 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 {{(pid=127307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:43:09.760497 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-1f619196-3321-4302-b98f-5116b99d2efd tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aedc727a81a40c2993097e35485233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399ad86f3c61455bba626fd9e556e6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:09.769288 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-1f619196-3321-4302-b98f-5116b99d2efd tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 200 len: 1349 microversion: 2.1 time: 0.104116 Aug 24 12:43:09.769785 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 521/1035] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:09 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 1349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:10.791959 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-22c6f15c-1020-4c0a-8cc2-8cd57452daad tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:10.792653 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-22c6f15c-1020-4c0a-8cc2-8cd57452daad tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] [instance: 88e9f003-88e1-43bb-8b20-9bb3c12bdb62] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:10.798740 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-22c6f15c-1020-4c0a-8cc2-8cd57452daad tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:10.799225 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-22c6f15c-1020-4c0a-8cc2-8cd57452daad tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:10.799684 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-22c6f15c-1020-4c0a-8cc2-8cd57452daad tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:10.800375 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-22c6f15c-1020-4c0a-8cc2-8cd57452daad tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:10.800829 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-22c6f15c-1020-4c0a-8cc2-8cd57452daad tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:10.801257 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-22c6f15c-1020-4c0a-8cc2-8cd57452daad tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:10.815368 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.wsgi [None req-22c6f15c-1020-4c0a-8cc2-8cd57452daad tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] HTTP exception thrown: Instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 could not be found. Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-22c6f15c-1020-4c0a-8cc2-8cd57452daad tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Request method failure captured: Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: request: GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 HTTP/1.1 Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept: application/json Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Accept-Encoding: identity Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Connection: close Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Length: 0 Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Content-Type: application/json Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Host: 10.222.0.58 Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Openstack-System-Scope: None Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: User-Agent: python-urllib3/1.26.11 Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Auth-Token: gAAAAABjBhxRw_w7BM4KvRut4vp01KYx6Vj8RRQ8vlSvnoGuuaPwa9qotoO3KVlwRM_eqDH9G_53XkFVpJqTDoOmCWChDDavyoX2-NZAC6T3eyxgUDlY_eDy2pC138jcyWULdoZGs8VhkPKLEXKDsYQ3ugc2GyIpaqIXyvC5JNdcjo-FXiqAQJk Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Id: None Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Domain-Name: None Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Identity-Status: Confirmed Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Is-Admin-Project: True Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Id: default Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Domain-Name: Default Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Id: 399ad86f3c61455bba626fd9e556e6e0 Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Project-Name: tempest-TestMinimumBasicScenario-135685366 Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Role: member,reader Aug 24 12:43:10.816999 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Roles: member,reader Aug 24 12:43:10.818528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/399ad86f3c61455bba626fd9e556e6e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/399ad86f3c61455bba626fd9e556e6e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/399ad86f3c61455bba626fd9e556e6e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_399ad86f3c61455bba626fd9e556e6e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:43:10.818528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant: tempest-TestMinimumBasicScenario-135685366 Aug 24 12:43:10.818528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Id: 399ad86f3c61455bba626fd9e556e6e0 Aug 24 12:43:10.818528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-Tenant-Name: tempest-TestMinimumBasicScenario-135685366 Aug 24 12:43:10.818528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User: tempest-TestMinimumBasicScenario-135685366-project Aug 24 12:43:10.818528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Id: default Aug 24 12:43:10.818528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Domain-Name: Default Aug 24 12:43:10.818528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Id: 8aedc727a81a40c2993097e35485233c Aug 24 12:43:10.818528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: X-User-Name: tempest-TestMinimumBasicScenario-135685366-project Aug 24 12:43:10.818528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: method: > Aug 24 12:43:10.818528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: exception: Instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 could not be found. Aug 24 12:43:10.818528 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: action_args: {'id': '88e9f003-88e1-43bb-8b20-9bb3c12bdb62'} Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 could not be found. Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:43:10.819412 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 could not be found. Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 could not be found. Aug 24 12:43:10.821074 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: ERROR nova.api.openstack.wsgi Aug 24 12:43:10.822994 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-22c6f15c-1020-4c0a-8cc2-8cd57452daad tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Returning 404 to user: Instance 88e9f003-88e1-43bb-8b20-9bb3c12bdb62 could not be found. {{(pid=127308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:43:10.822994 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-22c6f15c-1020-4c0a-8cc2-8cd57452daad tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62" status: 404 len: 111 microversion: 2.1 time: 0.031722 Aug 24 12:43:10.822994 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 515/1036] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:10 2022] GET /compute/v2.1/servers/88e9f003-88e1-43bb-8b20-9bb3c12bdb62 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:43:10.829576 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-057d79d0-e400-49f1-b477-3ad346616ba9 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] Calling method '.version_select at 0x7f46975774c0>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:10.848234 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-057d79d0-e400-49f1-b477-3ad346616ba9 tempest-TestMinimumBasicScenario-135685366 tempest-TestMinimumBasicScenario-135685366-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1639298170" status: 202 len: 0 microversion: 2.1 time: 0.023088 Aug 24 12:43:10.849028 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 522/1037] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 12:43:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1639298170 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:44:02.341553 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-b1ebe14a-06ec-4610-80e3-a65a3d7d16be tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:44:02.342113 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-b1ebe14a-06ec-4610-80e3-a65a3d7d16be tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:02.344635 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=14 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:44:02.345317 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:44:02.350700 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b1ebe14a-06ec-4610-80e3-a65a3d7d16be tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:02.351186 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b1ebe14a-06ec-4610-80e3-a65a3d7d16be tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:02.351614 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b1ebe14a-06ec-4610-80e3-a65a3d7d16be tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:02.352363 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b1ebe14a-06ec-4610-80e3-a65a3d7d16be tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:02.352910 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b1ebe14a-06ec-4610-80e3-a65a3d7d16be tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:02.353333 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-b1ebe14a-06ec-4610-80e3-a65a3d7d16be tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:02.377889 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-b1ebe14a-06ec-4610-80e3-a65a3d7d16be tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lazy-loading 'flavor' on Instance uuid f6803e92-5e64-4ecb-b624-22116193110f {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:44:02.453574 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-b1ebe14a-06ec-4610-80e3-a65a3d7d16be tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "POST /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f/action" status: 202 len: 0 microversion: 2.1 time: 0.115957 Aug 24 12:44:02.454294 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 516/1038] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 12:44:02 2022] POST /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:44:02.460222 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:44:02.460972 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:44:02.465051 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0a460af0-9c13-409c-b301-3f7af07eb938 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:02.465754 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0a460af0-9c13-409c-b301-3f7af07eb938 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:02.474061 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0a460af0-9c13-409c-b301-3f7af07eb938 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:02.474596 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0a460af0-9c13-409c-b301-3f7af07eb938 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:02.475070 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0a460af0-9c13-409c-b301-3f7af07eb938 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:02.475926 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0a460af0-9c13-409c-b301-3f7af07eb938 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:02.476385 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0a460af0-9c13-409c-b301-3f7af07eb938 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:02.476809 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0a460af0-9c13-409c-b301-3f7af07eb938 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:02.614969 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-0a460af0-9c13-409c-b301-3f7af07eb938 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:02.623350 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0a460af0-9c13-409c-b301-3f7af07eb938 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1570 microversion: 2.1 time: 0.164713 Aug 24 12:44:02.623938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 523/1039] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:02 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:03.645682 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-bc604ba9-eca2-4ad1-b994-4279af2eaeed tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:03.646382 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-bc604ba9-eca2-4ad1-b994-4279af2eaeed tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:03.652671 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bc604ba9-eca2-4ad1-b994-4279af2eaeed tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:03.653156 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bc604ba9-eca2-4ad1-b994-4279af2eaeed tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:03.653593 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bc604ba9-eca2-4ad1-b994-4279af2eaeed tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:03.654312 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bc604ba9-eca2-4ad1-b994-4279af2eaeed tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:03.654765 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bc604ba9-eca2-4ad1-b994-4279af2eaeed tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:03.655189 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bc604ba9-eca2-4ad1-b994-4279af2eaeed tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:03.788405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-bc604ba9-eca2-4ad1-b994-4279af2eaeed tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:03.796651 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-bc604ba9-eca2-4ad1-b994-4279af2eaeed tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1570 microversion: 2.1 time: 0.155632 Aug 24 12:44:03.797213 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 517/1040] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:03 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:44:04.817935 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-b87f8f58-1959-4cfc-a098-14ec33c83319 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:04.818550 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-b87f8f58-1959-4cfc-a098-14ec33c83319 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:04.825769 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b87f8f58-1959-4cfc-a098-14ec33c83319 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:04.826255 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b87f8f58-1959-4cfc-a098-14ec33c83319 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:04.826690 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b87f8f58-1959-4cfc-a098-14ec33c83319 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:04.827380 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b87f8f58-1959-4cfc-a098-14ec33c83319 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:04.827869 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b87f8f58-1959-4cfc-a098-14ec33c83319 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:04.828294 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-b87f8f58-1959-4cfc-a098-14ec33c83319 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:04.960709 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-b87f8f58-1959-4cfc-a098-14ec33c83319 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:04.968548 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-b87f8f58-1959-4cfc-a098-14ec33c83319 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1570 microversion: 2.1 time: 0.154421 Aug 24 12:44:04.969106 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 524/1041] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:04 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:05.989247 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-20332aa7-e40f-4c6e-bcf5-d7eda7913581 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:05.989793 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-20332aa7-e40f-4c6e-bcf5-d7eda7913581 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:05.996530 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-20332aa7-e40f-4c6e-bcf5-d7eda7913581 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:05.997112 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-20332aa7-e40f-4c6e-bcf5-d7eda7913581 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:05.997577 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-20332aa7-e40f-4c6e-bcf5-d7eda7913581 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:05.998292 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-20332aa7-e40f-4c6e-bcf5-d7eda7913581 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:05.998753 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-20332aa7-e40f-4c6e-bcf5-d7eda7913581 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:05.999179 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-20332aa7-e40f-4c6e-bcf5-d7eda7913581 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:06.127064 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-20332aa7-e40f-4c6e-bcf5-d7eda7913581 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:06.136219 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-20332aa7-e40f-4c6e-bcf5-d7eda7913581 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1570 microversion: 2.1 time: 0.150793 Aug 24 12:44:06.136783 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 518/1042] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:05 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:07.157827 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0814f0cd-76c0-45a5-8466-c0f23391c39f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:07.158443 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0814f0cd-76c0-45a5-8466-c0f23391c39f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:07.165003 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0814f0cd-76c0-45a5-8466-c0f23391c39f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:07.165489 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0814f0cd-76c0-45a5-8466-c0f23391c39f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:07.165930 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0814f0cd-76c0-45a5-8466-c0f23391c39f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:07.167271 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0814f0cd-76c0-45a5-8466-c0f23391c39f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:07.167759 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0814f0cd-76c0-45a5-8466-c0f23391c39f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:07.168188 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0814f0cd-76c0-45a5-8466-c0f23391c39f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:07.301319 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-0814f0cd-76c0-45a5-8466-c0f23391c39f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:07.309307 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0814f0cd-76c0-45a5-8466-c0f23391c39f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1570 microversion: 2.1 time: 0.155282 Aug 24 12:44:07.309815 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 525/1043] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:07 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:08.331066 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-07e5b385-4d66-4ed6-94db-70058a0d36e3 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:08.331692 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-07e5b385-4d66-4ed6-94db-70058a0d36e3 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:08.338375 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-07e5b385-4d66-4ed6-94db-70058a0d36e3 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:08.338882 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-07e5b385-4d66-4ed6-94db-70058a0d36e3 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:08.339311 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-07e5b385-4d66-4ed6-94db-70058a0d36e3 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:08.340053 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-07e5b385-4d66-4ed6-94db-70058a0d36e3 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:08.340500 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-07e5b385-4d66-4ed6-94db-70058a0d36e3 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:08.340915 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-07e5b385-4d66-4ed6-94db-70058a0d36e3 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:08.471400 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-07e5b385-4d66-4ed6-94db-70058a0d36e3 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:08.479845 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-07e5b385-4d66-4ed6-94db-70058a0d36e3 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1570 microversion: 2.1 time: 0.152473 Aug 24 12:44:08.480399 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 519/1044] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:08 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:09.500297 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-1fc92d3c-07c1-496e-b8d4-6fc32f7c6ec9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:09.500912 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-1fc92d3c-07c1-496e-b8d4-6fc32f7c6ec9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:09.507244 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1fc92d3c-07c1-496e-b8d4-6fc32f7c6ec9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:09.507769 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1fc92d3c-07c1-496e-b8d4-6fc32f7c6ec9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:09.508206 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1fc92d3c-07c1-496e-b8d4-6fc32f7c6ec9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:09.508894 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1fc92d3c-07c1-496e-b8d4-6fc32f7c6ec9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:09.509348 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1fc92d3c-07c1-496e-b8d4-6fc32f7c6ec9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:09.509791 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-1fc92d3c-07c1-496e-b8d4-6fc32f7c6ec9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:09.640893 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-1fc92d3c-07c1-496e-b8d4-6fc32f7c6ec9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:09.648504 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-1fc92d3c-07c1-496e-b8d4-6fc32f7c6ec9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1570 microversion: 2.1 time: 0.152045 Aug 24 12:44:09.649068 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 526/1045] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:09 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:10.670504 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-cf67dcb7-378f-4901-9cd6-ce124a1d4168 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:10.671097 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-cf67dcb7-378f-4901-9cd6-ce124a1d4168 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:10.677478 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cf67dcb7-378f-4901-9cd6-ce124a1d4168 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:10.677958 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cf67dcb7-378f-4901-9cd6-ce124a1d4168 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:10.678395 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cf67dcb7-378f-4901-9cd6-ce124a1d4168 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:10.679077 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cf67dcb7-378f-4901-9cd6-ce124a1d4168 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:10.679526 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cf67dcb7-378f-4901-9cd6-ce124a1d4168 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:10.679968 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-cf67dcb7-378f-4901-9cd6-ce124a1d4168 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:10.814933 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-cf67dcb7-378f-4901-9cd6-ce124a1d4168 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:10.822748 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-cf67dcb7-378f-4901-9cd6-ce124a1d4168 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1570 microversion: 2.1 time: 0.156565 Aug 24 12:44:10.823313 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 520/1046] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:10 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:44:11.843985 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e6ffa31b-4627-4ef2-90c2-3e38d605431a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:11.844614 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e6ffa31b-4627-4ef2-90c2-3e38d605431a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:11.850941 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e6ffa31b-4627-4ef2-90c2-3e38d605431a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:11.851425 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e6ffa31b-4627-4ef2-90c2-3e38d605431a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:11.851886 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e6ffa31b-4627-4ef2-90c2-3e38d605431a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:11.852569 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e6ffa31b-4627-4ef2-90c2-3e38d605431a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:11.853016 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e6ffa31b-4627-4ef2-90c2-3e38d605431a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:11.853434 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e6ffa31b-4627-4ef2-90c2-3e38d605431a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:11.990612 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e6ffa31b-4627-4ef2-90c2-3e38d605431a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:11.998228 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e6ffa31b-4627-4ef2-90c2-3e38d605431a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1570 microversion: 2.1 time: 0.158070 Aug 24 12:44:11.998795 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 527/1047] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:11 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:13.019383 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-c68d7564-83dc-46ba-a8d0-45123d9ae6c9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:13.020027 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-c68d7564-83dc-46ba-a8d0-45123d9ae6c9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:13.026413 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c68d7564-83dc-46ba-a8d0-45123d9ae6c9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:13.026898 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c68d7564-83dc-46ba-a8d0-45123d9ae6c9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:13.027333 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c68d7564-83dc-46ba-a8d0-45123d9ae6c9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:13.028060 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c68d7564-83dc-46ba-a8d0-45123d9ae6c9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:13.028515 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c68d7564-83dc-46ba-a8d0-45123d9ae6c9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:13.028941 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-c68d7564-83dc-46ba-a8d0-45123d9ae6c9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:13.223061 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-c68d7564-83dc-46ba-a8d0-45123d9ae6c9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:13.232090 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-c68d7564-83dc-46ba-a8d0-45123d9ae6c9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1570 microversion: 2.1 time: 0.216493 Aug 24 12:44:13.232655 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 521/1048] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:13 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1570 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:14.252668 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-59e24821-2a38-4e0b-a87a-aa2eedf0b779 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:14.253261 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-59e24821-2a38-4e0b-a87a-aa2eedf0b779 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:14.259744 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-59e24821-2a38-4e0b-a87a-aa2eedf0b779 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:14.260384 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-59e24821-2a38-4e0b-a87a-aa2eedf0b779 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:14.260817 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-59e24821-2a38-4e0b-a87a-aa2eedf0b779 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:14.261501 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-59e24821-2a38-4e0b-a87a-aa2eedf0b779 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:14.261948 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-59e24821-2a38-4e0b-a87a-aa2eedf0b779 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:14.262364 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-59e24821-2a38-4e0b-a87a-aa2eedf0b779 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:14.390194 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-59e24821-2a38-4e0b-a87a-aa2eedf0b779 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:14.397755 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-59e24821-2a38-4e0b-a87a-aa2eedf0b779 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1570 microversion: 2.1 time: 0.148901 Aug 24 12:44:14.398311 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 528/1049] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:14 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:15.418394 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4851d1ec-fccf-4739-8f9b-f55f9cdb28fd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:15.418983 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4851d1ec-fccf-4739-8f9b-f55f9cdb28fd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:15.425395 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4851d1ec-fccf-4739-8f9b-f55f9cdb28fd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:15.425877 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4851d1ec-fccf-4739-8f9b-f55f9cdb28fd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:15.426313 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4851d1ec-fccf-4739-8f9b-f55f9cdb28fd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:15.427000 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4851d1ec-fccf-4739-8f9b-f55f9cdb28fd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:15.427454 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4851d1ec-fccf-4739-8f9b-f55f9cdb28fd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:15.427900 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4851d1ec-fccf-4739-8f9b-f55f9cdb28fd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:15.559862 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4851d1ec-fccf-4739-8f9b-f55f9cdb28fd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:15.567407 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4851d1ec-fccf-4739-8f9b-f55f9cdb28fd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1511 microversion: 2.1 time: 0.152937 Aug 24 12:44:15.567981 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 522/1050] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:15 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:15.588272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e568108a-efeb-4721-9dd6-4ad3b84cec90 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:44:15.588960 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e568108a-efeb-4721-9dd6-4ad3b84cec90 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:15.595447 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e568108a-efeb-4721-9dd6-4ad3b84cec90 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:15.595973 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e568108a-efeb-4721-9dd6-4ad3b84cec90 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:15.596412 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e568108a-efeb-4721-9dd6-4ad3b84cec90 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:15.597111 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e568108a-efeb-4721-9dd6-4ad3b84cec90 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:15.597569 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e568108a-efeb-4721-9dd6-4ad3b84cec90 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:15.597997 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e568108a-efeb-4721-9dd6-4ad3b84cec90 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:15.626158 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e568108a-efeb-4721-9dd6-4ad3b84cec90 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127307) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 12:44:15.687722 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e568108a-efeb-4721-9dd6-4ad3b84cec90 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [ce955f88-a83e-470b-9504-adfb3795daa1] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 12:44:16.694793 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO oslo.messaging._drivers.impl_rabbit [None req-e568108a-efeb-4721-9dd6-4ad3b84cec90 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [ce955f88-a83e-470b-9504-adfb3795daa1] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 48624. Aug 24 12:44:16.698478 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e568108a-efeb-4721-9dd6-4ad3b84cec90 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "POST /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f/action" status: 202 len: 0 microversion: 2.1 time: 1.114158 Aug 24 12:44:16.699329 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 529/1051] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 12:44:15 2022] POST /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f/action => generated 0 bytes in 1116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:44:16.707541 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-65dba348-eae1-4449-8ca3-383b2a215dbe tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:16.708238 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-65dba348-eae1-4449-8ca3-383b2a215dbe tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:16.714979 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-65dba348-eae1-4449-8ca3-383b2a215dbe tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:16.715467 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-65dba348-eae1-4449-8ca3-383b2a215dbe tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:16.715940 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-65dba348-eae1-4449-8ca3-383b2a215dbe tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:16.716697 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-65dba348-eae1-4449-8ca3-383b2a215dbe tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:16.717376 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-65dba348-eae1-4449-8ca3-383b2a215dbe tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:16.717698 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-65dba348-eae1-4449-8ca3-383b2a215dbe tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:16.855514 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-65dba348-eae1-4449-8ca3-383b2a215dbe tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:16.863802 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-65dba348-eae1-4449-8ca3-383b2a215dbe tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1519 microversion: 2.1 time: 0.160322 Aug 24 12:44:16.864365 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 523/1052] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:16 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:17.886793 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-e8b65ce4-5b3f-415a-87c8-40215107063f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:17.887507 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-e8b65ce4-5b3f-415a-87c8-40215107063f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:17.894295 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e8b65ce4-5b3f-415a-87c8-40215107063f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:17.894784 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e8b65ce4-5b3f-415a-87c8-40215107063f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:17.895223 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e8b65ce4-5b3f-415a-87c8-40215107063f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:17.895975 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e8b65ce4-5b3f-415a-87c8-40215107063f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:17.896436 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e8b65ce4-5b3f-415a-87c8-40215107063f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:17.896864 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-e8b65ce4-5b3f-415a-87c8-40215107063f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:18.035652 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-e8b65ce4-5b3f-415a-87c8-40215107063f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:18.043643 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-e8b65ce4-5b3f-415a-87c8-40215107063f tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1519 microversion: 2.1 time: 0.161524 Aug 24 12:44:18.047663 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 530/1053] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:17 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:18.432974 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [req-5aad76d3-d954-4df6-8c17-0504f491eb5b req-3ab26e5c-d1a3-4169-a6ed-80f7166c4dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6803e92-5e64-4ecb-b624-22116193110f", "name": "network-vif-unplugged", "status": "completed", "tag": "91b08ae0-4c7e-4b5c-a0d3-b2cf3d03197d"}]} {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:44:18.442483 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-5aad76d3-d954-4df6-8c17-0504f491eb5b req-3ab26e5c-d1a3-4169-a6ed-80f7166c4dce service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:18.442935 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-5aad76d3-d954-4df6-8c17-0504f491eb5b req-3ab26e5c-d1a3-4169-a6ed-80f7166c4dce service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:18.443445 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [req-5aad76d3-d954-4df6-8c17-0504f491eb5b req-3ab26e5c-d1a3-4169-a6ed-80f7166c4dce service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:18.455963 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.compute.server_external_events [req-5aad76d3-d954-4df6-8c17-0504f491eb5b req-3ab26e5c-d1a3-4169-a6ed-80f7166c4dce service nova] Unable to find a host for instance f6803e92-5e64-4ecb-b624-22116193110f. Dropping event network-vif-unplugged {{(pid=127308) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 12:44:18.456841 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [req-5aad76d3-d954-4df6-8c17-0504f491eb5b req-3ab26e5c-d1a3-4169-a6ed-80f7166c4dce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.089581 Aug 24 12:44:18.457445 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 524/1054] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 91 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 12:44:19.063925 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-fae57312-46eb-4d6b-b436-81cf436951eb tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:19.064543 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-fae57312-46eb-4d6b-b436-81cf436951eb tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:19.070902 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fae57312-46eb-4d6b-b436-81cf436951eb tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:19.071392 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fae57312-46eb-4d6b-b436-81cf436951eb tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:19.071865 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fae57312-46eb-4d6b-b436-81cf436951eb tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:19.073212 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fae57312-46eb-4d6b-b436-81cf436951eb tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:19.073824 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fae57312-46eb-4d6b-b436-81cf436951eb tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:19.074513 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-fae57312-46eb-4d6b-b436-81cf436951eb tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:19.203926 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-fae57312-46eb-4d6b-b436-81cf436951eb tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:19.211610 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-fae57312-46eb-4d6b-b436-81cf436951eb tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1519 microversion: 2.1 time: 0.151536 Aug 24 12:44:19.212195 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 531/1055] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:19 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:20.234637 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-6da6b9ce-7fad-4945-a1f6-6f2da9765c4a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:20.235248 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-6da6b9ce-7fad-4945-a1f6-6f2da9765c4a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:20.241679 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6da6b9ce-7fad-4945-a1f6-6f2da9765c4a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:20.242168 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6da6b9ce-7fad-4945-a1f6-6f2da9765c4a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:20.242605 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6da6b9ce-7fad-4945-a1f6-6f2da9765c4a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:20.243290 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6da6b9ce-7fad-4945-a1f6-6f2da9765c4a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:20.243783 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6da6b9ce-7fad-4945-a1f6-6f2da9765c4a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:20.244277 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-6da6b9ce-7fad-4945-a1f6-6f2da9765c4a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:20.377132 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-6da6b9ce-7fad-4945-a1f6-6f2da9765c4a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:20.385825 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-6da6b9ce-7fad-4945-a1f6-6f2da9765c4a tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1519 microversion: 2.1 time: 0.154307 Aug 24 12:44:20.386450 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 525/1056] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:20 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:44:21.406752 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-0fe04720-b63f-4180-ba7a-6811b2b03e4e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:21.407366 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-0fe04720-b63f-4180-ba7a-6811b2b03e4e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:21.413768 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fe04720-b63f-4180-ba7a-6811b2b03e4e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:21.414248 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fe04720-b63f-4180-ba7a-6811b2b03e4e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:21.414683 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fe04720-b63f-4180-ba7a-6811b2b03e4e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:21.415370 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fe04720-b63f-4180-ba7a-6811b2b03e4e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:21.415852 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fe04720-b63f-4180-ba7a-6811b2b03e4e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:21.416275 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-0fe04720-b63f-4180-ba7a-6811b2b03e4e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:21.553061 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-0fe04720-b63f-4180-ba7a-6811b2b03e4e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:21.560968 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-0fe04720-b63f-4180-ba7a-6811b2b03e4e tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1519 microversion: 2.1 time: 0.158027 Aug 24 12:44:21.561744 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 532/1057] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:21 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:22.581166 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-4bc9f927-bd72-441e-a659-16eaee191480 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:22.581783 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-4bc9f927-bd72-441e-a659-16eaee191480 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:22.588099 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4bc9f927-bd72-441e-a659-16eaee191480 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:22.588587 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4bc9f927-bd72-441e-a659-16eaee191480 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:22.589195 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4bc9f927-bd72-441e-a659-16eaee191480 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:22.589908 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4bc9f927-bd72-441e-a659-16eaee191480 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:22.590359 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4bc9f927-bd72-441e-a659-16eaee191480 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:22.590785 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-4bc9f927-bd72-441e-a659-16eaee191480 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:22.793776 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-4bc9f927-bd72-441e-a659-16eaee191480 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:22.802107 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-4bc9f927-bd72-441e-a659-16eaee191480 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1577 microversion: 2.1 time: 0.224777 Aug 24 12:44:22.802677 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 526/1058] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:22 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:23.824659 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-f3c0a2e3-64a9-4ec8-85d8-875b9986e0db tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:23.825270 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-f3c0a2e3-64a9-4ec8-85d8-875b9986e0db tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:23.831704 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3c0a2e3-64a9-4ec8-85d8-875b9986e0db tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:23.832188 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3c0a2e3-64a9-4ec8-85d8-875b9986e0db tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:23.832615 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3c0a2e3-64a9-4ec8-85d8-875b9986e0db tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:23.833294 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3c0a2e3-64a9-4ec8-85d8-875b9986e0db tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:23.833740 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3c0a2e3-64a9-4ec8-85d8-875b9986e0db tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:23.834158 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-f3c0a2e3-64a9-4ec8-85d8-875b9986e0db tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:23.963287 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-f3c0a2e3-64a9-4ec8-85d8-875b9986e0db tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:23.971092 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-f3c0a2e3-64a9-4ec8-85d8-875b9986e0db tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1577 microversion: 2.1 time: 0.151270 Aug 24 12:44:23.971587 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 533/1059] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:23 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:24.991967 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-684f476f-372c-42dd-ab68-c5ad5407b679 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:24.992584 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-684f476f-372c-42dd-ab68-c5ad5407b679 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:24.999284 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-684f476f-372c-42dd-ab68-c5ad5407b679 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:24.999878 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-684f476f-372c-42dd-ab68-c5ad5407b679 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:25.000321 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-684f476f-372c-42dd-ab68-c5ad5407b679 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:25.001011 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-684f476f-372c-42dd-ab68-c5ad5407b679 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:25.001466 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-684f476f-372c-42dd-ab68-c5ad5407b679 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:25.001889 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-684f476f-372c-42dd-ab68-c5ad5407b679 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:25.134982 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-684f476f-372c-42dd-ab68-c5ad5407b679 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:25.143545 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-684f476f-372c-42dd-ab68-c5ad5407b679 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1577 microversion: 2.1 time: 0.155627 Aug 24 12:44:25.144138 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 527/1060] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:24 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:26.163928 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-bb9de529-a568-482a-837f-5f55e8ea8c08 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:26.164546 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-bb9de529-a568-482a-837f-5f55e8ea8c08 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:26.170862 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bb9de529-a568-482a-837f-5f55e8ea8c08 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:26.171346 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bb9de529-a568-482a-837f-5f55e8ea8c08 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:26.171820 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bb9de529-a568-482a-837f-5f55e8ea8c08 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:26.172514 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bb9de529-a568-482a-837f-5f55e8ea8c08 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:26.172974 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bb9de529-a568-482a-837f-5f55e8ea8c08 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:26.173400 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-bb9de529-a568-482a-837f-5f55e8ea8c08 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:26.301899 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-bb9de529-a568-482a-837f-5f55e8ea8c08 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:26.310211 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-bb9de529-a568-482a-837f-5f55e8ea8c08 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1577 microversion: 2.1 time: 0.150172 Aug 24 12:44:26.310770 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 534/1061] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:26 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:27.331314 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-507629d9-dd0b-42a7-9fb8-55eaa7f6e129 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:27.331967 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-507629d9-dd0b-42a7-9fb8-55eaa7f6e129 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:27.338425 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-507629d9-dd0b-42a7-9fb8-55eaa7f6e129 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:27.339577 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-507629d9-dd0b-42a7-9fb8-55eaa7f6e129 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:27.340222 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-507629d9-dd0b-42a7-9fb8-55eaa7f6e129 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:27.340917 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-507629d9-dd0b-42a7-9fb8-55eaa7f6e129 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:27.341376 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-507629d9-dd0b-42a7-9fb8-55eaa7f6e129 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:27.341801 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-507629d9-dd0b-42a7-9fb8-55eaa7f6e129 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:27.468659 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-507629d9-dd0b-42a7-9fb8-55eaa7f6e129 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:27.476275 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-507629d9-dd0b-42a7-9fb8-55eaa7f6e129 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1577 microversion: 2.1 time: 0.148782 Aug 24 12:44:27.476830 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 528/1062] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:27 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:44:28.497266 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-74b6f3a9-a75e-4ae8-9fbc-01584ec63bb7 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:28.497868 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-74b6f3a9-a75e-4ae8-9fbc-01584ec63bb7 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:28.504503 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74b6f3a9-a75e-4ae8-9fbc-01584ec63bb7 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:28.504982 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74b6f3a9-a75e-4ae8-9fbc-01584ec63bb7 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:28.505437 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74b6f3a9-a75e-4ae8-9fbc-01584ec63bb7 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:28.506118 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74b6f3a9-a75e-4ae8-9fbc-01584ec63bb7 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:28.506564 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74b6f3a9-a75e-4ae8-9fbc-01584ec63bb7 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:28.506979 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-74b6f3a9-a75e-4ae8-9fbc-01584ec63bb7 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:28.639723 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-74b6f3a9-a75e-4ae8-9fbc-01584ec63bb7 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:28.647361 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-74b6f3a9-a75e-4ae8-9fbc-01584ec63bb7 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1577 microversion: 2.1 time: 0.154091 Aug 24 12:44:28.647959 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 535/1063] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:28 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:29.670091 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-bbe0e952-4968-4aa8-9f5c-f0b31c4d2755 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:29.670633 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-bbe0e952-4968-4aa8-9f5c-f0b31c4d2755 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:29.676672 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bbe0e952-4968-4aa8-9f5c-f0b31c4d2755 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:29.677174 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bbe0e952-4968-4aa8-9f5c-f0b31c4d2755 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:29.677599 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bbe0e952-4968-4aa8-9f5c-f0b31c4d2755 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:29.678277 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bbe0e952-4968-4aa8-9f5c-f0b31c4d2755 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:29.678719 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bbe0e952-4968-4aa8-9f5c-f0b31c4d2755 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:29.679135 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-bbe0e952-4968-4aa8-9f5c-f0b31c4d2755 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:29.807008 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-bbe0e952-4968-4aa8-9f5c-f0b31c4d2755 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:29.814751 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-bbe0e952-4968-4aa8-9f5c-f0b31c4d2755 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1577 microversion: 2.1 time: 0.149134 Aug 24 12:44:29.815318 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 529/1064] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:29 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:30.837891 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-9e0200dc-17ec-4633-8854-6483309c9298 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:30.838494 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-9e0200dc-17ec-4633-8854-6483309c9298 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:30.850954 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9e0200dc-17ec-4633-8854-6483309c9298 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:30.851487 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9e0200dc-17ec-4633-8854-6483309c9298 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:30.851951 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9e0200dc-17ec-4633-8854-6483309c9298 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:30.852665 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9e0200dc-17ec-4633-8854-6483309c9298 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:30.853117 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9e0200dc-17ec-4633-8854-6483309c9298 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:30.853664 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-9e0200dc-17ec-4633-8854-6483309c9298 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:30.992436 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-9e0200dc-17ec-4633-8854-6483309c9298 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:31.000412 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-9e0200dc-17ec-4633-8854-6483309c9298 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1577 microversion: 2.1 time: 0.167754 Aug 24 12:44:31.000991 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 536/1065] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:30 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:31.958850 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:44:31.959269 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Wed Aug 24 12:44:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:44:32.021772 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-77fe7804-4692-4bd8-93b9-1b8f52bfa7ad tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:32.022423 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-77fe7804-4692-4bd8-93b9-1b8f52bfa7ad tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:32.028743 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77fe7804-4692-4bd8-93b9-1b8f52bfa7ad tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:32.029216 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77fe7804-4692-4bd8-93b9-1b8f52bfa7ad tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:32.029645 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77fe7804-4692-4bd8-93b9-1b8f52bfa7ad tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:32.030324 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77fe7804-4692-4bd8-93b9-1b8f52bfa7ad tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:32.030768 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77fe7804-4692-4bd8-93b9-1b8f52bfa7ad tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:32.031286 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-77fe7804-4692-4bd8-93b9-1b8f52bfa7ad tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:32.160137 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-77fe7804-4692-4bd8-93b9-1b8f52bfa7ad tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:32.167857 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-77fe7804-4692-4bd8-93b9-1b8f52bfa7ad tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1577 microversion: 2.1 time: 0.149870 Aug 24 12:44:32.168405 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 530/1066] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:32 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:32.509153 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-39b867e0-e3a8-4627-92c0-1fa61b06e950 req-520c6fc2-9107-4a46-a1bd-44052433caae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6803e92-5e64-4ecb-b624-22116193110f", "name": "network-vif-plugged", "status": "completed", "tag": "91b08ae0-4c7e-4b5c-a0d3-b2cf3d03197d"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:44:32.514788 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:44:32.521627 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-39b867e0-e3a8-4627-92c0-1fa61b06e950 req-520c6fc2-9107-4a46-a1bd-44052433caae service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:32.522272 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-39b867e0-e3a8-4627-92c0-1fa61b06e950 req-520c6fc2-9107-4a46-a1bd-44052433caae service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:32.522705 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-39b867e0-e3a8-4627-92c0-1fa61b06e950 req-520c6fc2-9107-4a46-a1bd-44052433caae service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:32.526917 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:44:32.535727 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-39b867e0-e3a8-4627-92c0-1fa61b06e950 req-520c6fc2-9107-4a46-a1bd-44052433caae service nova] Creating event network-vif-plugged:91b08ae0-4c7e-4b5c-a0d3-b2cf3d03197d for instance f6803e92-5e64-4ecb-b624-22116193110f on hv-cinder-84890 Aug 24 12:44:32.540769 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-39b867e0-e3a8-4627-92c0-1fa61b06e950 req-520c6fc2-9107-4a46-a1bd-44052433caae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035379 Aug 24 12:44:32.541522 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 537/1067] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:33.188886 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-88ab20b1-e9b6-41e8-aec1-6580857490d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:33.189446 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-88ab20b1-e9b6-41e8-aec1-6580857490d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:33.191767 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=31 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:44:33.196957 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-88ab20b1-e9b6-41e8-aec1-6580857490d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:33.197470 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-88ab20b1-e9b6-41e8-aec1-6580857490d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:33.197909 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-88ab20b1-e9b6-41e8-aec1-6580857490d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:33.198620 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-88ab20b1-e9b6-41e8-aec1-6580857490d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:33.199076 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-88ab20b1-e9b6-41e8-aec1-6580857490d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:33.199502 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-88ab20b1-e9b6-41e8-aec1-6580857490d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:33.202504 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:44:33.333223 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-88ab20b1-e9b6-41e8-aec1-6580857490d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:33.341695 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-88ab20b1-e9b6-41e8-aec1-6580857490d9 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1577 microversion: 2.1 time: 0.156715 Aug 24 12:44:33.342246 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 531/1068] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:33 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:44:34.363034 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-311ba3ff-3e1b-4a61-9400-554a8d5a00cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:34.363759 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-311ba3ff-3e1b-4a61-9400-554a8d5a00cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:34.372046 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-311ba3ff-3e1b-4a61-9400-554a8d5a00cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:34.372536 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-311ba3ff-3e1b-4a61-9400-554a8d5a00cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:34.372976 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-311ba3ff-3e1b-4a61-9400-554a8d5a00cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:34.373672 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-311ba3ff-3e1b-4a61-9400-554a8d5a00cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:34.374126 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-311ba3ff-3e1b-4a61-9400-554a8d5a00cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:34.374575 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-311ba3ff-3e1b-4a61-9400-554a8d5a00cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:34.504640 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-311ba3ff-3e1b-4a61-9400-554a8d5a00cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:44:34.512257 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-311ba3ff-3e1b-4a61-9400-554a8d5a00cd tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1564 microversion: 2.1 time: 0.153694 Aug 24 12:44:34.512813 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 538/1069] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:44:34 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:48.259951 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_api:SELECT=1 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:48.261023 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG dbcounter [-] [127308] Writing DB stats nova_cell1:SELECT=5 {{(pid=127308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:48.265855 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-2d12b86b-7d33-4182-838c-2dd8e5d04cc1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:48.266742 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2d12b86b-7d33-4182-838c-2dd8e5d04cc1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:48.271946 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-8f825ade-edb0-4297-ad24-de4019725849 req-75ab0e51-039c-4af9-892d-914734a0a0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6803e92-5e64-4ecb-b624-22116193110f", "tag": "91b08ae0-4c7e-4b5c-a0d3-b2cf3d03197d"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:45:48.274795 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2d12b86b-7d33-4182-838c-2dd8e5d04cc1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:48.275481 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2d12b86b-7d33-4182-838c-2dd8e5d04cc1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:48.275934 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2d12b86b-7d33-4182-838c-2dd8e5d04cc1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:48.276876 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2d12b86b-7d33-4182-838c-2dd8e5d04cc1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:48.277561 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2d12b86b-7d33-4182-838c-2dd8e5d04cc1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:48.278051 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-2d12b86b-7d33-4182-838c-2dd8e5d04cc1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:48.292913 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_api:SELECT=3 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:48.293944 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG dbcounter [-] [127307] Writing DB stats nova_cell1:SELECT=7 {{(pid=127307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:48.301748 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-8f825ade-edb0-4297-ad24-de4019725849 req-75ab0e51-039c-4af9-892d-914734a0a0b6 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:48.302239 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-8f825ade-edb0-4297-ad24-de4019725849 req-75ab0e51-039c-4af9-892d-914734a0a0b6 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:48.302674 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-8f825ade-edb0-4297-ad24-de4019725849 req-75ab0e51-039c-4af9-892d-914734a0a0b6 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:48.304534 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-2d12b86b-7d33-4182-838c-2dd8e5d04cc1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Going to try to terminate instance {{(pid=127308) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:45:48.316402 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-8f825ade-edb0-4297-ad24-de4019725849 req-75ab0e51-039c-4af9-892d-914734a0a0b6 service nova] Creating event network-changed:91b08ae0-4c7e-4b5c-a0d3-b2cf3d03197d for instance f6803e92-5e64-4ecb-b624-22116193110f on hv-cinder-84890 Aug 24 12:45:48.323009 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-8f825ade-edb0-4297-ad24-de4019725849 req-75ab0e51-039c-4af9-892d-914734a0a0b6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055654 Aug 24 12:45:48.323665 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 539/1070] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:48.400355 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-2d12b86b-7d33-4182-838c-2dd8e5d04cc1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 204 len: 0 microversion: 2.1 time: 0.141972 Aug 24 12:45:48.404416 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 532/1071] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 12:45:48 2022] DELETE /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:45:48.411636 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-8017fbf2-e66a-4543-aedf-b739739c0d78 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:48.412531 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-8017fbf2-e66a-4543-aedf-b739739c0d78 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:48.423137 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8017fbf2-e66a-4543-aedf-b739739c0d78 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:48.425205 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8017fbf2-e66a-4543-aedf-b739739c0d78 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:48.426161 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8017fbf2-e66a-4543-aedf-b739739c0d78 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:48.429321 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8017fbf2-e66a-4543-aedf-b739739c0d78 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:48.429860 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8017fbf2-e66a-4543-aedf-b739739c0d78 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:48.430384 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-8017fbf2-e66a-4543-aedf-b739739c0d78 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:48.710271 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.policy [None req-8017fbf2-e66a-4543-aedf-b739739c0d78 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:48.718731 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-8017fbf2-e66a-4543-aedf-b739739c0d78 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1570 microversion: 2.1 time: 0.311416 Aug 24 12:45:48.719479 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 540/1072] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:48 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1570 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:49.740581 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-9595b7b9-f368-4a25-a3f5-e770c69c658c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:49.741283 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-9595b7b9-f368-4a25-a3f5-e770c69c658c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:49.747674 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9595b7b9-f368-4a25-a3f5-e770c69c658c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:49.748165 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9595b7b9-f368-4a25-a3f5-e770c69c658c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:49.748605 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9595b7b9-f368-4a25-a3f5-e770c69c658c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:49.749296 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9595b7b9-f368-4a25-a3f5-e770c69c658c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:49.749781 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9595b7b9-f368-4a25-a3f5-e770c69c658c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:49.750379 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-9595b7b9-f368-4a25-a3f5-e770c69c658c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:49.906821 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-9595b7b9-f368-4a25-a3f5-e770c69c658c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:49.915425 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-9595b7b9-f368-4a25-a3f5-e770c69c658c tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1570 microversion: 2.1 time: 0.178947 Aug 24 12:45:49.916191 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 533/1073] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:49 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:50.477938 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [req-c4a3f469-9126-4fa0-956a-ff66f8011517 req-e5661f02-1752-4386-90fb-6cec2e54d106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6803e92-5e64-4ecb-b624-22116193110f", "name": "network-vif-deleted", "tag": "91b08ae0-4c7e-4b5c-a0d3-b2cf3d03197d"}]} {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:45:50.488053 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-c4a3f469-9126-4fa0-956a-ff66f8011517 req-e5661f02-1752-4386-90fb-6cec2e54d106 service nova] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:50.488537 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-c4a3f469-9126-4fa0-956a-ff66f8011517 req-e5661f02-1752-4386-90fb-6cec2e54d106 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:50.489157 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [req-c4a3f469-9126-4fa0-956a-ff66f8011517 req-e5661f02-1752-4386-90fb-6cec2e54d106 service nova] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:50.500702 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.compute.server_external_events [req-c4a3f469-9126-4fa0-956a-ff66f8011517 req-e5661f02-1752-4386-90fb-6cec2e54d106 service nova] Creating event network-vif-deleted:91b08ae0-4c7e-4b5c-a0d3-b2cf3d03197d for instance f6803e92-5e64-4ecb-b624-22116193110f on hv-cinder-84890 Aug 24 12:45:50.505715 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [req-c4a3f469-9126-4fa0-956a-ff66f8011517 req-e5661f02-1752-4386-90fb-6cec2e54d106 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100740 Aug 24 12:45:50.506348 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 541/1074] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 12:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:50.938002 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-0055bb67-4760-4f53-aed7-b9e214e9d6f1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:50.938558 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.compute.api [None req-0055bb67-4760-4f53-aed7-b9e214e9d6f1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127308) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:50.944809 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0055bb67-4760-4f53-aed7-b9e214e9d6f1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:50.945292 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0055bb67-4760-4f53-aed7-b9e214e9d6f1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:50.945763 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0055bb67-4760-4f53-aed7-b9e214e9d6f1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:50.946452 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0055bb67-4760-4f53-aed7-b9e214e9d6f1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:50.946904 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0055bb67-4760-4f53-aed7-b9e214e9d6f1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:50.947339 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0055bb67-4760-4f53-aed7-b9e214e9d6f1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:50.982144 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0055bb67-4760-4f53-aed7-b9e214e9d6f1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:50.982625 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0055bb67-4760-4f53-aed7-b9e214e9d6f1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:50.983065 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG oslo_concurrency.lockutils [None req-0055bb67-4760-4f53-aed7-b9e214e9d6f1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:50.983505 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.objects.instance [None req-0055bb67-4760-4f53-aed7-b9e214e9d6f1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lazy-loading 'fault' on Instance uuid f6803e92-5e64-4ecb-b624-22116193110f {{(pid=127308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:45:51.024509 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.policy [None req-0055bb67-4760-4f53-aed7-b9e214e9d6f1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf01094f0a444f2396426866d134d222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf72fd7c24f4691b49b142f53d81ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127308) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:51.032675 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-0055bb67-4760-4f53-aed7-b9e214e9d6f1 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 200 len: 1388 microversion: 2.1 time: 0.099495 Aug 24 12:45:51.033245 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 534/1075] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:50 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 1388 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:52.054570 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-948b4e2b-1b64-4168-b535-20c6b0708bd0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '>' {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:52.055278 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.compute.api [None req-948b4e2b-1b64-4168-b535-20c6b0708bd0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] [instance: f6803e92-5e64-4ecb-b624-22116193110f] Fetching instance by UUID {{(pid=127307) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:52.061517 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-948b4e2b-1b64-4168-b535-20c6b0708bd0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:52.062590 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-948b4e2b-1b64-4168-b535-20c6b0708bd0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:52.063034 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-948b4e2b-1b64-4168-b535-20c6b0708bd0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:52.063753 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-948b4e2b-1b64-4168-b535-20c6b0708bd0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Acquiring lock "87459494-59a1-454d-a2fa-293053432209" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:52.064217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-948b4e2b-1b64-4168-b535-20c6b0708bd0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:52.064645 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG oslo_concurrency.lockutils [None req-948b4e2b-1b64-4168-b535-20c6b0708bd0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Lock "87459494-59a1-454d-a2fa-293053432209" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:52.078293 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.wsgi [None req-948b4e2b-1b64-4168-b535-20c6b0708bd0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] HTTP exception thrown: Instance f6803e92-5e64-4ecb-b624-22116193110f could not be found. Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-948b4e2b-1b64-4168-b535-20c6b0708bd0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Request method failure captured: Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: request: GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f HTTP/1.1 Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept: application/json Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Accept-Encoding: identity Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Connection: close Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Length: 0 Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Content-Type: application/json Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Host: 10.222.0.58 Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Openstack-System-Scope: None Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: User-Agent: python-urllib3/1.26.11 Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Auth-Token: gAAAAABjBhx2Dhlzgpr_n1Fn_E5OX7xvpuPIQgPgOzVlbxphYWcCFLmsTG3tWqOcThCUUY83fy5fzUq3B5ppPmCw43oEUcEpYVHEiBoBL3QOg-IjpDMtZb8vXWl5Ze2jUoBZ4JbPgxSR7_u3-HPB-mSKYjax1sO0sPpgmv1wtBz1oNFDQJu_xt8 Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Id: None Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Domain-Name: None Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Identity-Status: Confirmed Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Is-Admin-Project: True Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Id: default Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Domain-Name: Default Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Id: dcf72fd7c24f4691b49b142f53d81ea0 Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Project-Name: tempest-TestShelveInstance-1945545084 Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Role: member,reader Aug 24 12:45:52.079949 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Roles: member,reader Aug 24 12:45:52.081900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dcf72fd7c24f4691b49b142f53d81ea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dcf72fd7c24f4691b49b142f53d81ea0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dcf72fd7c24f4691b49b142f53d81ea0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dcf72fd7c24f4691b49b142f53d81ea0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 24 12:45:52.081900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant: tempest-TestShelveInstance-1945545084 Aug 24 12:45:52.081900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Id: dcf72fd7c24f4691b49b142f53d81ea0 Aug 24 12:45:52.081900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-Tenant-Name: tempest-TestShelveInstance-1945545084 Aug 24 12:45:52.081900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User: tempest-TestShelveInstance-1945545084-project Aug 24 12:45:52.081900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Id: default Aug 24 12:45:52.081900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Domain-Name: Default Aug 24 12:45:52.081900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Id: bf01094f0a444f2396426866d134d222 Aug 24 12:45:52.081900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: X-User-Name: tempest-TestShelveInstance-1945545084-project Aug 24 12:45:52.081900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: method: > Aug 24 12:45:52.081900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: exception: Instance f6803e92-5e64-4ecb-b624-22116193110f could not be found. Aug 24 12:45:52.081900 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: action_args: {'id': 'f6803e92-5e64-4ecb-b624-22116193110f'} Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: {{(pid=127307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6803e92-5e64-4ecb-b624-22116193110f could not be found. Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:45:52.083217 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6803e92-5e64-4ecb-b624-22116193110f could not be found. Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6803e92-5e64-4ecb-b624-22116193110f could not be found. Aug 24 12:45:52.085065 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: ERROR nova.api.openstack.wsgi Aug 24 12:45:52.086630 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: DEBUG nova.api.openstack.wsgi [None req-948b4e2b-1b64-4168-b535-20c6b0708bd0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Returning 404 to user: Instance f6803e92-5e64-4ecb-b624-22116193110f could not be found. {{(pid=127307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:45:52.086630 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO nova.api.openstack.requestlog [None req-948b4e2b-1b64-4168-b535-20c6b0708bd0 tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f" status: 404 len: 111 microversion: 2.1 time: 0.031417 Aug 24 12:45:52.086630 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: [pid: 127307|app: 0|req: 542/1076] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:52 2022] GET /compute/v2.1/servers/f6803e92-5e64-4ecb-b624-22116193110f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:45:52.241826 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: DEBUG nova.api.openstack.wsgi [None req-6ebb4fe4-b972-4c4b-ae71-40f8688893eb tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] Calling method '.version_select at 0x7f4696b26430>' {{(pid=127308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:52.260406 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO nova.api.openstack.requestlog [None req-6ebb4fe4-b972-4c4b-ae71-40f8688893eb tempest-TestShelveInstance-1945545084 tempest-TestShelveInstance-1945545084-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1171590083" status: 202 len: 0 microversion: 2.1 time: 0.022358 Aug 24 12:45:52.260979 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: [pid: 127308|app: 0|req: 535/1077] 10.222.0.58 () {58 vars in 1254 bytes} [Wed Aug 24 12:45:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1171590083 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:45:57.812568 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:45:57.812568 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Wed Aug 24 12:45:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:47:51.967896 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:47:51.968417 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Wed Aug 24 12:47:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:48:00.329197 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:48:00.330171 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Wed Aug 24 12:48:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:48:04.590811 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:48:04.591375 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Wed Aug 24 12:48:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:49:17.822332 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:49:17.823086 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Wed Aug 24 12:49:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:49:22.236516 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:49:22.237244 dv-cinder-848900-5-iscsi devstack@n-api.service[127307]: Wed Aug 24 12:49:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:50:58.226839 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:50:58.227376 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Wed Aug 24 12:50:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:51:11.976854 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:51:11.977497 dv-cinder-848900-5-iscsi devstack@n-api.service[127308]: Wed Aug 24 12:51:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!